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ABSTRACT 

The purpose of this program was to demonstrate the 
effectiveness of a tape-recorded, sequenced program of auditory 
perceptual training in .raising the reading and listening skill levels 
of students in grades two to six. .£ighty*£ive hoys and 67 girls in 
the second grade and 25 boys and 14 girls in learning disability 
group clinics in grades t%io to six participated in the program. The 
students %iere given tape-recorded lessons twice a week. The lessons 
were given free field by the teachers in the second grade classroqms 
to the entire class at one time. . In the learning disability groups, 
children took the lessons in groups of two to six in listening 
centers. .A total of 39 lessons and four Interim Review Tests, also 
tape-rocorded, were given over a six-month period, .children in th§ 
learning disability groups could take the lessons over until they 
maste ed them before taking the Interim Review Tests. .The Gilmore 
Oral Reading Test, a tape-recorded criterion-referenced listening 
test, the Lindamood Auditory Conceptualization Test, and t^e Short 
Form Test of Academic Ability were used to assess progress.^. The 
results indicated that criterion levels were reached on three of the 
four Interim Review Tests. The students made significant pre-post 
test gains on most of: the variables, but replication of the study for 
a third year was suggested. . (HR) 
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SECTION E - PHOJBCT CLASSIFICATION 

1. Project Siibjecta 2. Handicapped Education 
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If yes, name the agency operating the project: 
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COVER PAGE 



for Component II 

Data for S. Office of Education 

(To be completed for all projects active for any period 
between July 1971 - through June 3a, 1972. Agencies 
having more than one project must prepare a report for 
each project.) 

Enter information for items 1 through 7. 

Alameda County 

0471 2^ Reading Improvement though 3. Superintendent of Schools 

Project No« Local Educational Agency 

Auditoiry Perceptual Trainin g. 224 ifest Winton Avenue 
Project Title 

Havward. CA 94544 



Address 



Rock La Fleche, Superintendent 5. Belle Ruth Witkin^ Ph.D. 

Name of school official respon- Name of Project Director 
sible for this report 

783-5800 - 783-5800 

Phone No. Phone No. 

The 1971-72 school year has been 

fi-1 I J The first year of operation. 



6.2 ] A I The second year of operation. 

6.3 I -I The third year of operation* 



6.4 I I A project which ended on or before June 30, 1971 but had a 

special extension to operate a period of time after July 1, 1971 

Enter the following dates: 

Ending date for first year June 30, 1971 

Ending date for second year June 30, 1972 

Ending date for third and final yea r June 30, 1973 

Ending date for extension period 

if extension was granted 



PART I - STAFF DEVELOPMENT 



Tlio roport nhould doscribo project ntaff development activities that t^^^^ 
place during the period July 1, 1971, through June 30, 1972. If f 
Staff development activities occurred, vrite NONE in the first column. Staff 
development activities are t^ose inservice efforts designed to improve corn- 
potencies of the staff working full or part-time on the project. Enter the 
figures in colunins two and three. 
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STAFF DEVELOPMEW ACTIVITIES OF OIIE OR 1«RE DAYS IWRATION 

1971-72 



(1) 

Definition of Staff: 
(Staff includes all 
personnel assigned 
to work on the 
project full or 
part time, whether 
paid by the district 
or the project.) 



(2) 

Total No. of 
participants 
(Unduplicated) 
in all 
activities. 



(3) 

No, of workshops, conferences and seminars 
l^olrj b y tyiie of training 



Dissemi- 
nation to 
spread 
informa- 
tion 
about 
project 



Evalu- 
atiorPtO" 
appraise 
progress 



Coabina- 
tion of 
dissemi- 
nation & 
evalua- 
tion 



Other, such 
as in-seirvice 
education* 
Specify '(Use 
back of this 
page.) 



PART n - EXTEtJT OF ADOPTlON/ifflAPTiGN 



1971-i972 



DOES NOT APPLY 



The purpose of this section is to find cut hov rany projects are being 
continued* to' soize extent by the grantee or by other school disoricts' after 
federal funds have expired, 

The report should be liraited to projects for vrhich federal funds expired 
during the period July 1^ 1971 thi-ough June 30, 1972. If the grantee district 
cxp3ct5 to continue the project to sone extent during the ne:ct fiscal year, 
this should bo reported by r:arking the box. The cstiriated erctent of adoption 
or adaption by the graiitee district should be shown by circling the appropriate 
j)orcentngo figure* in the five point scale, 

1. The project ij? boin.j co ntinued by the gran tee in some form after 
federal funds expired, f i YesL,^ | No 

Z. If the ancvcr is YcS^ drav a circle around the figure which represents 
your orti!ratc of the doirreo of adoption/adaption of the project in your 
school diiitrict. 



lOcH 
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PAUT III - EXTEHT OF rARTICIPATlON 
1971-1972 

The purpose of this part of the report is to find out the actual direct or 
indirect participation of public and private school pupils and adults in the 
project during the 1971-72 operational period. 

Any participation should be reported only once. The count should be based 
on actual participation during the 1971-72 school year. The numbers are almost 
certain to be different from those anticipated in the project application. 

The United States Office of Education definitions should be applied: 

Direct Particlontion - Enter the number of different persons participating 
in activities involvins face-to- face interaction of pupils and teachers 
(in case of in-sorvicc traininjj, teachers and instructors) designed to 
produce learning, in a classroora, a center or mobile unit; or receiving 
other Special services. 

■ Indirect Partlcioatton - Enter the number of different persons visiting 
or vicving cshibics, desionstrations, ttuseusi displays; using materials 
or cquiprcent developed or purchased by the project; attending performances 
of plays, synphonies, etc.; viewing television instruction in a school, 
a center, or heme; or participating in other. similar activities. Carefully 
prepared estlnutes are acceptable. 

Elementary - For reporting purposes only, consider elementary as being 
Pre-Kindergarten through Grade 6. 

Sccoadary - Foi reporting purposes only, consider secondary as being 
Grades 7 through 12. 



Please supply the infomation requested for the project. 



Item I 



C.KUMBER Of PU3L:C ANO NONPUBLIC SCHOOL STUDENTS, TEACHERS. AND COUNSELORS PARTICIPATING 
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TA.^Y 
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i /II 
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•.r.} 


Public 


158 




13 








120 refet.) 
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1 




Kon public 


1 33 




1 








' i 
? 




1 





♦Experimental classes in Alameda County 
districts only. 

Item II Indicate hov nany of the ^bove students are from rural/urban areas. 
.Totals should equal the fisures aboveT 



Rural areas _ 

(Fann or cities under 2,500 pop.) 

Urban areas 191 (Alameda Coxinty) 
(Cities over 2,500 pop.) 



The total of these must equal 
b, elementary, c, secondary, 
from Item 1 above. 



**Alternate test sites: Santa Ana, California, and Eastern Washington State 
College, Cheney, Washington. No cost to Title III. ^ 
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PART IV 



Information in Part Vt is only for the past budget period* 
Note: The total number of students in the following 3 charts must agree 
one idth the other* 

X - Experimental group 
f C - Control group 



.ntOCRAM 
€•} 


Check 
subject area 
covered 


Mo* of 

students 

partici- 
pating ^ 


Amount 
granted this 

past year 


Readme 


X 


x-i^i > 


^ 87.1^71 


EnviroAfr.c-fil/ Ccology 




C-176 1 




Equnl Educational Opportuntt/ 








Model Cities (Urhon, IntiefCity) 








GUied 








||andicat-p**d 








Cuid«incr uttd Counselini; 








DrvK EducjirioD 








Early ChiKhood Education 








Other pto^rurxs 









NUMBER OP STUDENTS SERVED SY TARGET POPULATIONS (Figures may be iiuplicated) 



STUO£NT$ 
M 


PROJECT 
FOR 
INDIANS 


PROJECT 

FOR 
MtCRANTS 

M 


PROJECT 
FOR 
OISAD* 
VANTACEO 
(d> 


PROJECT 
FOR 
HANOI* 
CAPPED 

M 


PROJECT 
FOR EARLY 
CHILONOOO 
EDUCATION 


PROJECT FOR 
OTHER TARGET 
POPULATIONS 

{§} 


Number of 


1 


- , « . ' 


- 




l-^. 1 


387 

... 



and 2-6 Graders in learning disability clinics. 
Provide tinduplicated counts of target population students by grade levels. 



Levels 


Pre-K| K | 1 


2 


1 3 ! 4. 15 j 6 f 7 ; 8-9 : . 10 1 11 J 12 1 


Public 


1 


256 


j 17 1 20 1 19 i 6 j j 1 i j 1 


Kon-Dublic 


i 


1^5 


! i i i 1 i i i ■ j 1 



Provide number of professional staff directly involved in project. See Part III 
for definitions - directly/indirectly • 





* Elementary j 
R^sic Skillc 1 


Secondaiy 
Basic Skills 


jSecondary vocational 
^<^\r^Us & attittKlc55 


Project for... 


Under 
1 Hnlf^tjno 


i^ill j 

T3T.C! . 1 


Under 
1 Half-time 


Full 
Tltne 


.Under 
•Half-time 


Full 
Time 


HancHcnpnnf^ 














Nbn- i 
handicapped li 


X - l»^ 
i C - 6 






1 


t 





^Includes classroom teachers only. 



Provide number of non-profesaional staff directly involved in project. 



Project for.ee 


Less than half-time 


RtLl time 


Handlcnnoed children 




>» 


Regular elementary and 
senondarv 55tudents 






Provide number of teachers who had training as a result of project and 
cost ot training-count can be duplicated e 




• Number 


Cost of activity 


Workshops 

(traininrr F.eetinjis) 6 


51 




Orientations 2 


^7 


\ $647.91 



For the above number, indicate how many participated in workshops 
lasting more than four weeks e e 



Provide number of schools in project. 

Elementary 10 

Secondary ; . 

Provide number of non-certificated personnel who deceived training 
from the project and cost of training • 

Number: Cost of Training 



Provide number of students participating in project activities in 
summer school in 1972 at the levels indicated • 

Pr e-kinclergarten : ^ 

Kindergarten : - 

Other Elementary: ' 

Secondary: - 
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Reading Improvement through Auditory Perceptual Training 
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TARGET POPULATION 

85 boys and 67 girls in grade 2, and 25 boys and m girls in learning disability 
group clinics in grades 2 to 6. 136 were white, 23 black, 2 oriental, 3 American 
Indian, and 27 Spanish surname. All social classes were represented, but 90 per- 
cent were of average or low social class. 

PARAGRAPH DESCRIPTION 

Students learned to improve their auditory perceptual skills by taking tape- 
recorded lessons twice a week. The lessons were given free field by teachers 
in the second grade classrooms to* the entire class at one time. In the learning 
disability groups, children took the lessons in groups of two to six in listen- 
ing centers, sometimes using earphones. There were 39 lessons given over a 
six-month period from November through April. Four Interim Review Tests, also 
tape-recorded, were given. Children in the learning disability groups could 
take the lessons over until they mastered them before taking the Interim 
Review Tests. The lessons were developed specifically for. this project. 



MAJOR OBJECTIVES 

To demonstrate the effectiveness of a tape-recorded, sequenced program of audi-, 
tory perceptual training, in raising the reading and listening skill levels of 
students in grades 2 to 6. By June 1973, the project will have demonstrated 
the utility and feasibility of the APT program in raising the level of auditory 
perceptual skills of primary grade children to specified criteria, and will 
furnish guidelines and, cost/effectiveness data for its adaptation to a variety 
of gpade levels, student learning abilities, classroom situations, and teacher 
interventions. ^ 

ACTIVITIES TO ACHIEVE OBJ^TIVES ' 

1.0 Provide management capability for the project. 

.0 Develop and produce revised materials for field testing. ^ 

Conduct field test of revised materials. 

Conduct process evaluation. ' 

Conduct product evaluation. 

Pr^ovide for dissemination. 



2. 
3. 
^. 
5. 



6^0 



EVALUATION STRATEGY 

Three-way analysis or covariance, using one analysis with gain scores in 
reading as the dependent variable, the other with gain scores in listening as 
the dependent variable. Tests used were: Gilmore Oral Reading Test, a tape- 
recorded criterion- referenced listening test, Lindamood Auditory Conceptualiza- 
tion Test, and the Short Fom Test of Academic Ability. The listening test was 
developed specifically for this project. 



EVALUATION FINDINGS " ' 

Criterion levels were reached on 3 of the ^ Interim Review Tests. The fourth unit 
proved too difficult, and is being revised. APT program students made significant 
pre-post test gains on most of the variables, but due to non-comparability of the 
comparison groups, results were ^ not conclusive aiid the design will need replica- 
tion in the 3rd year. 
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4. CHILDREN RECEIVIMC SERVICES - DISTRIBUTION BY OEMOCRAPMIC AREA 
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primary handicap (in pubUc and nou^publk schooisi and by 
asc |ioup sho received direct instructional or reiated "services 
uith Title ill lund<s. Diis count ^houid include aU handicapped 
children fi) who received direct sfwes from personnel paid 
with Title III funds and/or (2} v. ho received subsuntlal benefit 
as a result of the purchase or projects equipment or the ^rovi- 
^ion of significant in'Service tratnmg of personnel with Title III 
funds. Do not include handicapped children who received only 
incidental seiv'cct. such as prelimtiiary vision screening or audio* 
lo^ea; testing, etc. Column f should equal columns b. c, d* 
ind e. 
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END OF BUDGET PERIOD REPORT 
TITLE III. ESEA 



COMPONENT III 



PROGRAM NARRATIVE REPORT 



PROGRAM 



Activities or Services 

!• What were the ma^n activities (or services) in the program? 
2. How were these activities (or services) related to specified program 
objectives? 

3* What methods were used in carrying out each activity (or service)? 
^. What was a typical day's or week's schedule of activities for the 

children (or others) who received the program? 
5* How were pupils grouped for the various program activities? 

6. What were teacher-pupil ratios (or aid-pupil, or adult-pupil, and so 
on) in each of these groupings? 

7. How did pupils (or others) receive feedback on their individual daily 
progress? 

8. How did parents receive feedback on their child's progress? 

9. What amounts and kinds of practice, review, and quiz activities were 
provided for pupils (or others) in the program? 

10. What special provisions were made for motivating pupils (or others)? 

11. If a comparison group was used, what were important differences in the 
activities and methods used in this group and the activities and methods 
used with the program group? 



1^0 What were the main activities for services'^ in the program? 

1.1 Revision of the APT program materials from 1970-71 and development 
^ of new materials. 'lotal package included a criterion- referenced 

tape-reco3Xled test, the Composite Auditory Perceptual Test (CAPT) , 
consisting of two ejections, each one-half hour in length; 39 tape* 
recorded lessons, averaging 9 to 13 minutes in length; four 
! Interim Review Tests, also criterion- referenced; and student 

response booklets to accompany all tapes. 

1.2 All students in experimental and control groups were given a 
^ battery of individual and group pretests and posttests. 

i 

^ 1.3 From November 1971 to April 1972, the students in the experimental 

^ classrooms received the tape-recorded APT lessons. There were two 

groups: Group A, children in second grade classrooms, most of 
whom were below grade level in reading ability; and Group B, chil- 
dren who were attending learning disability group clinics for a 
part of their instruction, and who were in grades two thTOugh six. 

m Orientation and evaluation woi?kshops were held for participating 
teachers and administrators. 

2.0 How were these activities (or services) related to specified program 
objectives? ^ --.^ , . 

All of the activities were in direct support of the mission objective 
for 1971-72, which had been stated as follows: 

•'The mission objective for the second year of the project will be to 
demonstrate the effectiveness of the Auditory Perceptual Training 
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program (API) developed by the project > in improving the reading 
ability and auditory perceptual abilities of students in two target 
populations 9 Groups A and B** (described in question I above). 

All activities si^ported.a field test of the materials which had been 
developed specifically for the project. The field testing activities 
were designed to demonstrate whether the experimental groups made a 
statistically significant gain in both auditory perceptual abilities 
and oral reading abilities over a control group ^ in order to determine 
whether the APT program would be generalizable to similar groups. 

3.0 Methods used in carrying out each activity for serviced 

3.1 Revision of materials 

Three principal consultants > who had developed the materials 
specifically for the project^ were eng;aged in the revision. 
They were: 

Katharine G. Butler, Ph.D., San Jose Sirete College 
Dona Lea Hedrick, Fh.D.> University of Washington 
Charlie C. Manning, Ph.D., Mary Bridge Children's Hospital, 
Tacoma, Washington 

An editorial consultant, Molly Cone, who is a well-known author 
of children's books, assisted in the revision and designed the 
student response booklets. 

All tape-recorded and printed materials were developed according 
to exacting specifications* 

3.2 Testing 

The tape-recorded pre- and posttest and a group achievement test 
were administered by the technical assistant to the project. An 
oral reading test was administered individually by graduate stu- 
dents in educational psychology from Cal-State, Hayward. All 
tests were scored by the project staff* 

3.3 Lessons 

Teachers gave the tape-recorded lessons on the average of twice 
a week in their classrooms, using reel-»to-reel tape recorders. 
Ji} the second grade classrooms all children took the lessons at 
the same time, free field. In the learning disability groups 
^ they worked in very small groups and could take the lessons over 
again until they achieved mastery. In some clinics earphones 
were used. Interim Review Tests, also tape-recorded, were given 
by the project technical assistant. All lessons and tests were 
scored by the project staff. Except in the learning disability 
groups, teachers admdlnistered the program with a minimum of inter- 
vention and with no supplementary activities, in order to determine 
the efficacy of the tape-recorded program by itself. All lessons 
were corrected and scored by the project staff. 
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3*^ Teacher inservice 



Five one«day workshops and several one»haIf day sessions were 
held with teachers and administrators for orientation , monitoring, 
evaluation 9 and. planning. 

^.0 Typical dav^s or week's schedule of activitie a> 

Children received the tape-recorded lessons on en average of twice a 
week. Each class had its own schedule , but the lessons for any given 
class were given at the same time on the same days* 

S.O How were pupils grouped? 

In Group A there were no special groupings of the c!iildren« MI took 
the lessons and tests at the same time and in the same way; if they 
were absent , they were allowed to make up the lessons or tests 
individually. 

In Group students worked closely with a learning disability clinicirr^^ 
usually in groups of to to six. 

6*0 Teacher^pupil ratios . 

In Group A the teacher^pupil ratio averaged 1 to 30. In Qroup B the 
average was 1 to ^. 

7.0 How did pupils receive feedback. on their individual daily progress? 

Pupils received feedback on progVcss on each lesson through procejiures 
built in to the tape recordings. On each page of the response book*- 
lets the responses were made the first time in blue* The tape-recorded 
narrator then gave the stiimili a second time and in many cases described 
the reasons for the choices made, and students checked their answers in 
red. All response booklets consisted of rows of pictures which pre*- 
vided multiple choice answers to the different perceptual tasks, end 
the children made responses by marking the appropriate picture with en 
X, a circle ^ or a line under the picture. Feedback then consisted of 
the visual match of the red and blue marks. 

8.0 How did parents i^ceive feedback on their child* s proi^ress? 

No feedback was given to the parents, since the field test for this 
year was designed to provide structured learning experiences with a 
minimum of intervention or encouragement from teachers or parents. 

9.0 Amounts and kinds of practice^ review^ and quiz activities provided . 

The lessons themselves contained enough items for prastice and mastery 
of the different perceptual tasks, iloviews were provided through the 
four Interim Review Tests, which contained samples of the octivities 
that had been performed in the pravious lessons of each set. 
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10;0 Special provisions for motivating pupils . 

Motivation was built in to the tape recordings through (1) the use 
of different voices; (2) the character of Siricee the clown, who 
acted as a principal narrator and who related many of the activities 
to daily experiences of students; and (3) the novelty of most of the 
tasks themselves. Narrators talked very directly to the students 
and overt verbal responses were often elicited. The colorful and 
well designed listening boohs were also motivating. The project 
director visited all the classes, explained the purpose of the field 
testing, and asked for feedback from the children on how the mater- 
ials could be made more interesting and effective for other boys and 
girls. 

11.0 Comparison group activities differences . 

Control groups were used for both A and B students. The control 
groups received only the pre- aiid posttests and no special listening, 
training. Alternate listening experiences had been built in to the 
original design, but this feature had to be omitted because of lack 
of funds. 



Dissemination 

Disscuss how project information was disseminated during the past budget 
period. 

1. Provide an estimate of the number of unsolicited requests for informa- 
tion from both within and outside the project area. 

2. List the number of visitors from outside the project area. 

3. Provide the cost of dissemination during the last budget period. 

M*. Provide the total cost of dissemination including prior budget periods 
(if possible) . 



1. Estimate of the number of unsolicited requests for information from 
both within and outside the project area. 

The number of unsolicited requests for information from inside the 
project area was 17, and from outside the project area was IM^. 

2. List the number of visitors fixxn outside the project area . 

There were 9 visitors to the project from outside the project area. 

3. Cost of dissemination . 

There were no direct costs for dissemination this year. Nearly 200 
slides of the project were taken and several slide presentations 
developed, but the cost was bozne by the Alameda County School Depart- 
ment Cuxrriculum Materials Center. 

M^. Total cost of dissemination, including prior budget periods . 

There have been no costs for dissemination in previous budget periods. 



No particular efforts were made to disseminate information about the 
project within Alameda County, aside from news stories in the Superinten- 
dent's Bulletin , a monthly publication which goes to all credentialed 
persons in the county. This was mainly because there is such a dearth of 
auditory perceptual training materials, that teachers hearing about APT 
want to use them before they are adequately tested. Special reports were 
made to the Alameda County Board of Education, the Curriculum Division of 
the Alameda County School Department, and teachers and adininistretors who 
paiiricipated in the first year of the project. A slide presentation was 
developed for these presentations. Teachers from two of the project 
schools have made brief presentations to their faculties at district work^ 
shops, and another teacher gave a presentation at a meeting. of a profes- 
sional organization of primary grade teachers. 
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The director also wrote a paper » ^^Components of Listening Ability: 
An Analysis of Auditory Skills based on the factor analysis of the 
pretest battery from 1970-71* The co-author was Dr* Thomas Whalen^ 
assistant professor in educational psychology » California State University » 
Hayward, who was the evaluation consultant for the p3?oject. The paper was 
delivered at the Calif oxtiia Educational Research Association meeting in 
November 1971^ and is being submitted to professional journals for 
publication* 



The director also described the pp^ect at a Preconvention Institute 
of the International Reading Associati()|i^in May 1972* This was at no 



cost to Title III. 
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Sll^f^ATIVE EVALUATION REPORT 
for 

Reading Improvement through 
Auditory Perceptual Training 

ESEA Title III 



by 

Thomas E. Whalen, Ph.D. 
Evaluation Consultant 



EVALUATION 



Choosing Participants 

1. How were the children and the adults in the program chosen? 

Two groups of children took part in the APT project. Group A consisted 
of second grade children fixim six elementary schools in Alameda County. 
These children were selected after meetings and discussions with members of 
an advisory committee on selection, which consisted mainly of administrators 
from the various school districts. Criteria to be used for selection were 
promulgated by the project director as follows: (1) classrooms should 
contain a majority of children reading below grade level, and (2) the pop- 
ulation should be diverse from an academic, social class, and ethnic stand-- 
point. A practical consideration was that classes must be selected only 
from schools in which two second grades of comparable ability were located , 
in order to provide for comparability of experimental and control samples. 

Group B children consisted of 80 students in grades three through six 
in the Fremont School District. These children,, who had been assigned to 
Learning Disability Clinics based upon previous diagnosis, were selected 
for participation in the APT project by the LDG clinicians. Twenty students 
were selected by each of four clinicians using the criterion that the stu- 
dents be retarded at least two years in reading ability as measured by the 
Gilmore Oral Accuracy Subtest. 

The teacher?? of students in both groups A and B volunteered to partic- 
ipate in the project. 

2. How was a comparison group chosen? 

The oonti?ol samples for Groups A and B were selected in slightly dif- 
ferent manners. For Group A, as indicated above, a decision was reached 
conjointly by the project director and the advisory committee as to which 
schools should participate in the project. Once this decision was reached, 
the designation of experimental and control classes within the schools was 
to be made on a random basis, allowing for the principle of randomization 
to correct for any initial differences between the classes. Ideally, this 
procedure should have produced statistically comparable X and C classes. 
However, in reality, this was not the case. Although the project director 
clearly specified the necessity for equivalent groups and the criteria for 
assignment of classrooms to groups, these criteria were not uniformly 
applied by administrators and teachers within the schools. Since class- 
rooms were selected before the beginning of the school year, it was pos- 
sible for principals and teachers to assign children • into* classes with the 
knowledge that the child would receive spfediiil ptojfedt treatment or not. 
Apparently, the natural altruistic philosophy of many school personnel 
clouded their judgments with regard to the assignment of students. Thus, 
students who were felt to need the treatment were assigned in greater 
numbers to the experimental classes. This situation is reflected in the 
pretest data (shown in the appendix) which indicated that on several im- 
portant measures the control group children performed significantly higher 
than the project children. 
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In Group B, decisions concerning the assignment of children to the 
comparison group were made by the LDG clinicians independently. Of the 
twenty children selected by each clinician, ten were assigned as control 
pupils on the basis of their age, sex, and standardized test information. 
Once again the project director pointed out clearly the need for carefully 
matched groups. However, as with Group A, decisions were not made on the 
basis of empirical evidence alone. The pretest results also indicated 
that Group B control children were significantly more advanced in several 
of the skills tested. 

3. Were participants in the program involved in othe r programs? 

The children were not involved in any other experimental programs. 
AH students, of course, received related instruction in the language arts 
curriculum. 

U> How many children left the program? 

Pretest data were gathered on a total of 291 children in Group A. 
This number was reduced through attrition to 255 students for whom post 
test data were available. 

In Group B pretests were administered to 76 students, of whom 66 were 
post tested at the conclusion of the program. 

5. Which participants left? 

Most of the attrition was due to pupil mobility, i.e., moving out 
of the school district. Some of the attrition was due to absence of the 
child at the time of post testing. No systematic attempt was made to 
determine the characteristics of students who left the program since the 
assumption was made that variables affecting pre-post differences due to 
attrition would be randomized across experimental and control groups. 

6. Were participants added to the program to re place dropouts? 

Pupils who entered project classrooms were allowed to cycle into the 
APT program since the lessons were given on a total-class basis. However, 
for purposes of data analysis, their test scores were not used. 

7. Were there many participants who did not receive the program often 
because of poor attendance? ^ 

Attendance data were collected on all students in terms of the number 
of project lessons missed. The mean number of lessons missed for all stu- 
dents was only two lessons. Naturally, this variable was characterized by 
a skewed distribution with a small proportion of students missing consid- 
erably more than two lessons. Attendance rates were not considered to 
depart from normal class attendance, however, and this was not considered 
to be a problem for the project. 

8. Did participants attend voluntarily? 

Project schools and teachers volunteered. Project pupils did not 
volunteer since the program was an integral part of the class curriculum. 
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9. Was the evaluation p ; rouo only a portion of the program group? 

With the exception of a few students who came into the project after 
it started, all participants were used in the overall evaluation. 
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Describing Partici4?ants 



1> Which participants received the program? 

Those participants designated as the experimental samples in Groups A 
and B received the program. 

2. How many participants received the program? ■ 

In Group A, six second grade classrooms totaling 152 children were 
administered the APT materials. ' There were thirty-nine Group B children 
in four learning disability clinics who received the program. 

3. What are the ages and grade levels of pupils in the program? 

In Group A, ages ranged from 81 to 111 months. Most students were 
from 81+ to 90 months of age (seven to seven and one-half years of age) at 
the start of the program. The mean age for students in the experimental 
sample was 90*53 months. Control group students had a mean age of 90.12 
months at the start of the project. All of these pupils attended the 
second grade. * , ■ 

Group B students ranged in age from 83 to 1^15 months (six years and 
eleven months to twelve years and one month) . They were spread fairly 
evenly across these age levels. The mean ages for the X and C groups, 
respectively, were m.85 and 118.35 at the start of the project. These 
pupils were considered to be third through sixth graders. 

Note: See Appendix A for a. more detailed description of the target 
population. 

Did the program serve many more boys than girls, or vice versa ? 

In Group A, the second grade group, there were 85 boys and 67 girls 
in the experimental sample. The comparison group contained 70 boys and 
69 girls. The learning disability group contained 25 boys and 14 girls 
in the target sample, and 30 boys and 7 girls in the control sample. As 
is evident from these latter figures, considerably more boys than girls 
were present in the LDG classes. 

Note: See Ajppendix A" for a more detailed description of the 
target population. 

5. What achievement scores were available before the program with which 
to describe the program group? ^ L_ 

For the second grade sample, because the classes were not constituted" 
prior to the designation of experimental and control classes within proj- 
ect schools, no data were accessible on individual students before the 
project started. Data were gathered on several important variables at the 
beginning of the 1971-72 academic year. These included' ethnic group mem- 
bership, language dialect, socioeconomic background, and age. These 



measures were used along with other standardized and objectives-based 
test scores for descriptive and comparative purposes. 

Pupils in the LDG sample had various standardized achievement and 
aptitude scores on record depending on their age and grade standing. 
These measures were used to identify them initially as LDG students and 
ultimately for inclusion into the APT project. 

Note: See Appendix A for more detailed descriptions of the target 
population and for comparisons between experimental and control groups. 

6. Are there other special characteristics you should mention in 
describing the program group? 

An Index of Social Position (HoUingshead, 1957)''' was used to deter- 
mine the socioeconomic level of the target population. Information was 
gathered through a Written questionnaire sent to parents of all children 
in the sample. The index combines level of education with type of occupa- 
tion in two weighted scales. Scores range on a continuum from a low of 11 
(highest ISP) to a high of 77 (lowest ISP) . The mean index scores for the 
experimental and control groups in the second grade sample were 48.46 and 
47.55, respectively, indicating no appreciable difference in the groups. 
In the LDG samples the X and C means were 42.68 and 47.08, respectively, 
indicating a slightly higher social status for the experimental pupils. 

One feature which differed across X and C samples in the second grade 
group was language dialect. Although the vast majority of students were 
speakers of standard English, there was a disproportionate number of pupils 
in .the experimental group who spoke Black English, twenty versus three 
students in the control group. 



Hollingshead, August B. Two Factor Index of Social Position . 1957. 
1965 Yale Station, New Haven, Connecticut. 
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Measuring Change 



1. What measures were applied to find out whether the program's aims were 
achieved? 



The following standardized tests were used to measure broad objectives 
of the program: 

1. Gilmore Oral Reading Test: accuracy, comprehension, and rate 
subtests* 

2. Short Form Test of Academic Achievement: vocabulary, analogies, 
sequences, and memory subtests. 

3« Lindamood Auditory Conceptualization test. 

The following objectives-based tests were administered: 

1. Composite Auditory Perceptual Test: competing messages subtests 
(4) , and auditory discrimination subtests (3) • 

2. Interim Review Tests (4): competing messages and auditory dis- 
crimination subtests « 

In addition, data were collected to assess student listening ability 
via a 7-point teacher rating. scale. 

Note: See Table 1 for a more detailed description of the tests. 

2. How were the measures matched to the objectives? 

The overall objectives of the project as stated in the Continuation 
Application for 1971-72 were as follows: 

"The following student performance objectives, will be met for both 
groups (A and B) : 

"a. At the completion of the APT program, the treatment group 
will shov; a statistically significant mean gain in reading 
comprehension, as measured by the Gilmore Oral Reading test, 
over the mean gain of a control group (p s .05). 

"b. At the- completion of the APT program, the treatment group 
will show a statistically significant gain in listening 
performance, as measured by the criterion-referenced Composite 
Auditory Perceptual Test (CAPT) , over the mean gain of a 
control group (p ^ .05). 

"c. At the completion of the APT program, the treatment group will 
perform significantly better on a standardized information- 
processing test (Token Test) than a control group (p ^ .05) 
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*'d. Eighty percent (80 percent) of the S's in Group A and sixty 
percent (60 percent) of the S*s in Group B will meet the 
criteria for performance on the four Interim Review Tests 
(IRT)." 

Since the objectives were stated operationally in terms of the test 
used, a clear relationship is evident between objectives and tests. One 
departure was made from the set of objectives listed above. The Token 
Test w s deemed inappropriate by the project consultants and was replaced 
by the Lindamood Test of Auditory Conceptualization for purposes of 
measuring information processing. 

3. How were the measures matched to pupils* capabilities? 

Based upon experience gained during the first year of the project, 
the director was able to. select instruments tailored to students' achieve-* 
ment capabilities. The Gilmore Oral Reading Test includes a wide range of 
reading levels inclusive of grades 1 through 9. It was ideally suited to 
group A, the second grade sample, with very few exceptions. There were a 
few students who scored at the bottom of the scale on the pretest. All 
but one of these made measurable gains on the post test. In group B, all 
but one of the students fell within normal ranges on the subtests. In 
general, this test is considered to be an excellent choice in terms of 
'measuring the project objectives and for providing data which could be 
compared across the two separate groups. 

The Lindamood test is equally robust in its range of abilities. It 
ha^ norms for grades K through 12. All students scored within suitable 
ranges on this test. 

The Composite Auditory Perceptual Test (CAPT) and the Interim 
Review Tests (IRT's) were designed by the curriculum consultants to 
measite the specific behavioral objectives of the APT lessons. In gen- 
eral, the tests were quite successful in this regard. Two problems became 
apparent early in the year, however. On the CAPT pretest, many students 
were unable to make appropriate procedural responses. That is, even 
though they knew the correct answer to an item, they marked the response 
incorrectly (by circling the item instead of underlining it, for example). 
Thus, in scoring the test two sets of scores had to be used*->one which 
included marking errors and one which did not. This condition caused con- 
siderable difficulty in scoring the test and made for a lack of precision 
in the instrument.' Another problem which was partially anticipated con- 
cerned the difficulty levels of the lessons and IRT's. Because the teach- 
ers were not allowed to intervene in the learning experience provided via 
tape recordings, the lack of feedback to the students caused some of them 
to have extra difficulty with lessons and IRT's. This was especially 
true during the fourth sequence of lessons, and consequently many students 
did not reach criterion levels on the Hth IRT. 

^. Were observers specially trained? 

All test administrators were trained prior to giving tests. The pre- 
and post-CAPTS and IRT's were administered by a .well-qualified, full-time 
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assistant to the director. The 6iliTK>re pretests were given by a group of 
graduate students from California State University , Hayward. These stu- 
dents were trained by the research assistant In the use and scoring of 
the reading tests. Their level of expertise was also verified by the 
evaluation consultant prior to testing dates. One of the above graduate 
students contracted to administer the post tests, 

5. How much time elapsed between testings? 

Pretests were administered in October. Post tests were given in 
May. The four Interim Review Tests were given at intervals of four to 
six \fee\(s. 



Presenting Data 



1. What data were obtelned from the measures applied? 

The appendix contains several tables summarizing the data collected • 
Table 2 is a description of the target population. Table 3 shows base** 
line data and initial differences between the X and C groups. Tables H 
and 5 show pre*post achievement growth for experimental groups A and 
respectively. Tables 6 and 7 present summary statistics of yearly growth 
for all subgroups and experimental-control comparisons for groups A and 
Bf respectively. 

2* What measures of central tendency were used? 

In all cases> where interval data were involved, arithmetic means 
were used for measures of central tendency. For those variables involve* 
ing categorical data such as sex, ethnic group membership, and language 
dialect, simple frequency counts were used for comparisons across sub- 
groups. 

3^ What measures of dispersion were used? 

Standard deviations were used as measures of dispersion in all cases. 

4* What are the overall results of the analyses, i.e., was the program 
effective? 

Based upon data shown in Tables H to 7 in the appendix, it is diffi«- 
cult to show positive results for the APT curriculum. Only one subtest 
showed significant gains for both A and B experimental groups over their 
comparison groups. This was the first competing messages subtest, which 
measured recognition of spondee words undar conditions of varying signal*- 
to-^distraction ratios. Moreover, some tests actually showed greater 
gainS'Over the year for the control groups than for the project pupils. 

However, because of the fact that X and C groups were not equivalent 
initially, it is extremely difficult to draw definite conclusions from 
the data. The analysis of covariance, which takes into account initial 
differences between the groups to some extent, did reflect some slight 
changes in outcomes, but these shifts were not great enough to claim slg«- 
nlficant gains in favor of project pupils. 

In addition, several intervening variables combined during the course 
of the project to cast further doubt on the results obtained from the post 
test data. For example, it was found that a small, but significant number 
of project pupils had fairly large decrements in performance over the year. 
This was not true to the same extent in the comparison groups. Thus, group 
means were lowered considerably in the experimental groups by a few 
extremely low scores. This could have resulted from the fact that these 

\ slower learners received no feedback or intervention from their teachers 

and consequently suffered morale and motivational effects resulting in 

I apparent decrements in performance. The frequent testing of project pupils 

could also have affected these students adversely. 
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Another anomaly which arose upon inspection of post test data was 
the fact that 'project students made significantly more marking errors on 
the post test despite the fact that they had been trained to respond cor- 
rectly during the entire sequence of lessons « There appears to be some 
unknown factor at work which served to divert project students from 
appropriate marking procedures to a total cognitive involvement in the 
substance of the lessons. 

Finally, an error was mae^ in post testing procedures which could 
have affected scores in the experimental sample* In two classrooms, 
baffles were used to prevent students from copying. This procedure was 
not used in any of the control group classes* 

An analysis of the validity and reliability of the CAPT as an instru* 
ment for testing auditory perception showed that it possesses fairly 
acceptable characteristics as a criterion referenced test* The overall 
test-retest reliability was a .66 over a seven month period. Table 8 
shows reliability coefficients for the AD and CM subtests, as well. The 
test is also significantly related to other measures of language ability 
such as the SFTAA and Gilmore tests. An independent study of the instru- 
ment on children in grades one through three also showed that (1) per- 
formance on i'he CAIT improved with grade level increments and with 
increase in age, (2) those subjects deemed to be highiy competent read- 
ers by their teachers tended to do better on the CAPT than those who 
were rated as medium or low readers, (3) there were no significant 
differences found between performances of boys and ^irls, and (4) a 
moderate relation«hip existed between CAPT performance and socioeconomic 
status of the children. Once the scoring procedures are rem^rcied, the 
test should serve as a useful diagnostic instrument. 

In conclusion, the APT project appears to be making significant 
progress toward unveiling some hitherto imknown dimensions of auditory 
pror >8lng In young children. It is also having some degree of success 
in ueveloping a curriculum to teach these newly Identified skills. But 
if the APT package is to be accepted for dissemination to other school 
districts upon the completion of next year's program, it will be impera- 
tive to know beyond a doubt if the lessons are Indeed producing measur- 
able gains In listening achievement. Thus, it is recommended that this 
year's design be replicated next year for a small, carefully selected 
and controlled sample of pupils in order to reach a final decision 
regarding the merit of the lessons. 
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Analyzing Data 



1. What analyses were undertaken of the dat^? 

Comparisons were made between experimental and control groiaps on all 
descriptive variables including sex, age, ethnic group membership, lan- 
guage dialect, and social class. Comparisons were also made on all pre- 
and post test achievement variables such as the teacher ratings of stu- 
dents listening ability, the Gilmore Oral Reading Test, the CAPT, SFTAA, 
and Lirii^?:Tnood Tests. Independent t-tests were used for all of the 
achievement comparisons; means and frequency counts were calculated for 
the descriptive measures. Additional comparisons were made between pre- 
and post test scores within the experimental and control groups. A 
correlated t-model was used for this analysis. 

The following additional analyses were carried out: 

1. Determination of any ordering effect due to the different test- 
ing sequence for AD and CM subtests of the CAPT. See Table 9. 

2. Determination of relationships between pretest variables and 
sociological factors, and among the various subtests. See Tables 
10 and 11. 

3. Determination of principal parameters of auditory perception for 
purposes of revising and/or shortening the CAPT. 

Standardization of ^^retest scores for purposes of placing stu- 
dents within their norm groups and for constructing individual 
profiles of student achievement. 

5. Calculation of correlation matrix for pretest CAPT scores, IRT*s, 
and post test scores. See Table 12. 

6. Determination of the test-retest reliability of the CAPT: AD and 
CM subsections and total score. See Table 8. 

7. Regression analysis followed by a factorial anaZ.ysis of variance 
on two dependent variables, Gilmore Oral Reading Test and CAPT 
total scores, using pretest scores and initial language ability 
as covariates. 

8. Calculation of standard scores on all pre- and post test varia- 
bles for purposes of charting student growth profiles. 

In addition, the project director monitored lesson-by-lesson growth 
for a stratified subsample of Group A and Group B students to determine the 
effects of the »^rogram on students at various levels o^f initial reading and 
listening abi^^-y. Also, a graduate student from Cal-State, Hayward, under 
the dual supei sion of the director and evaluator, administered the CAPT 
to a separate -.nple of children in grades 1 to 3 for purposes of norming ' 
the instrument and to check results with those of project testing. 



See section titled "Factor Analysis," page 33. 
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2. What was the basis for judging the progress of the program group? 



Raw score and grade equivalency scores were analyzed to determine 
growth from pre- to post tests within the program group. These same 
measures were used to compare growth rates of the program and control 
samples. 

3. What comparisons were drawn for subsamples? 

Comparisons were made for. all test sco.^es between the experimental 
and control samples in both A and B groups. Also, within Group A, the 
experimental group was subdivided into good and poor readers and lis- 
teners in order to determine any interactive effects of the program on 
students. ~ ~ ^ 

^. What evidence is there that those who attended more gained more from 

the program? , ^ 

Data were collected on the number of lessons and Interim Review Tests 
missed by each student. These data were correlated with post test achieve- 
ment scores to determine relationsiiips. Among the second grade sample the 
average pupil missed only two lessons, though a small number of students 
missed considerably more than this mean figure. On the whole, one student 
in three missed one of the Interim Review Tests. 

Evidence indicates a significant negative relationship between 
absence and listening achievement as measured by the CAPT. A coefficient 
of -.31 was computed for this relationship. Since the relationship between 
absence and reading achievement was near zero, it can be inferred that stu- 
dents who attended more lesb as did benefit to a greater extent than their 
absent peers from the listening exercises. 
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FACTOR ANALYSIS 



In order to determine the principal parameters of auditory perception, 
so that the CAPT could be revised and/or shortened for future use, a factor 
analysis was done on the pretest battery. Pretest data gathered from 290 
second graders in both the experimental and control groups were subjected 
to a principal components factor analysis followed by Kaiser^ s varimax 
rotation. The data included scores on 15 separate variables: a teacher 
rating of the child's listening ability; accuracy, comprehension, and rate 
scores from the Gilmore Oral Reading Test; four competing messages (CM) 
scores and three auditory discrimination (AD) scores from the Composite "~ 
Auditory Perceptual Test (CAPT) , and four subtest scores f3?om the Short 
Form Test of Academic Achievement (SFTAA) • Table I contains a numbered 
list of the variables with a brief description for each. 

Three separate analyses were made. On the first run, only those fac- 
tors with eigenvalues greater than one were retained and rotated. The 
results of this analysis are shown in Table 13. The first factor in this 
model was identified as a reading factor because all of the Gilmore sub- 
tests were included with very high loadings. Variable 1, the teacher rat- 
ing of student listening ability^ also correlated moderately with this 
factor, indicating that teachers apparently rated the student's reading' 
ability instead of his listening ability. This could have happened because 
of a general halo effect, or because the teacher's perception of listening 
ability was not in accord with the specific skills of listening defined 
and measured by other project tests. 

Factor II contained high loadings for all of the competing message 
subtests (variables 5 through 8). Because of the nature of these sub- 
tests, this factor was identified as a resistance-to-distraction or 
figure-ground factor. The existence of this factor lends further support 
to the validity of the CAPT as a multidimensional listening test. 

Factor III was the most difficult to interpret due to the large number 
of heterogeneous variables which loaded on it. All of the AD subtests had 
moderate loadings, and both the verbal and non-verbal SFTAA subtests had 
high loadings on this factor. Because of the lack of purity of this fac- 
tor, a decision was made to make a second analysis by rotating four fac- 
tors with the expectation that some of the subtests in Factor. Ill would 
break off and form a fourth factor. 

Table m shows the results of the 4-factor model. As expected, Fac- • 
tors I and II remained stable, but two of the SFTAA subtests broke off to 
form a fourth factor. This factor included the analogies and sequences 
subtests of the SFTAA, both non-verbal scales, and a moderate loading for 
variable 10, the second AD subtest. Thus, Factor IV could now be identi- 
fied as a non-language dimension within the pretest battery. 

Factor III, in the H-f actor model, now contained moderate-to-high 
loadings for two of the three AD subtests and for two of the language sub- 
tests of the SFTAA. Therefore, this factor was determined to be a lingu- 
istic and phonological 'dimension of the battery. 
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A final analysis was made in which five factors were rotated. The 
subsequent pattern of loadings, shown in Table 15, indicated that only 
one variable, the third AD subtest, loaded at all on Factor V. The other 
AD subtests remained split across Factors I, II, and IV, From this anal- 
ysis, it was concluded that the AD subtests of the CAPT lack a central 
focus of measuremerit. Whereas all of the CM subtests cluster as one 
factor with relatively high loadings, the AD variables are split across 
reading, phonological-linguistic, and non-language factors. 

In summary, three separate factor analyses were performed on data 
gathered on fifteen pretest scales. After analyzing the. loadings for the 
3^^ if-^ and 5-f actor paradigms, the ^-f actor model emerged as the most 
plausible empirical representation of the test battery. The four factors 
were identified as (1) reading, (2) resistance-to-distraction, (3) lingu- 
istic-phonological, and (^) non-language. These four factors accounted 
for approximately sixty-three percent of the total variance in the test 
scores. 



Summary of Four-Factor Model of Auditory Perception 



Factor I 



Factor II 



Factor III 



Factor IV 



Teacher rating of 
student listening 
ability 
Oral reading accuracy 
Oral reading 

comprehension 
Oral reading rate 
Auditory closure 
Auditory synthesis 



Competing 
messages 



Auditory 
discrimination 

Recognition of lingu- 
istic forms 

Vocabulary 

Delayed memory 



Nonverbal 
analogies 

Nonverbal 
sequences 



PROCESS EVALUATION REPORT 

READING IMPROVEMENT THROUGH AUDITORY 
PERCEPTUAL TRAINING 

Prepared by 

Education/Research, Inc. 
2831 Seventh Street 
Berkeley, California 94710 



Procedural Objectives and Findings 
1. What were the procedural objectives of the program? 
Procedural objective 1. 0 



Procedural objective 2. 0 



Procedural objective 3. 0 



Procedural objective 4. 0 



Procedural objective 5. 0 



Procedural objective 6. 0 
Procedural objective 7. 0 



To provide management capability 
for the project. 

To complete the project evaluation 
for fiscal year 1970-71 with reference 
to the effectiveness of both product 
and process. 

To develop and produce revised in- 
structional materials to be used in 
the field test phase during the second 
year of the project. 

To conduct field testing of revised 
A. P. T. materials for botti treatment 
and control groups. 

To conduct a feasibility study of the 
use of rate controlled (compressed) 
speech for improved listening and 
reading rate and comprehension. 

To conduct a process evaluation of 
the project activities. 

To conduct a product evaluation of the 
project. 
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Procedural objective 8*0 To provide for dissemination of 

project results. 
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2. State the findings in ordinary language for each objective. 



1. 0 To provide management capability for the project. 

A. Evaluation Activities 

1* The evaluators interviewed the Project Director, 
her technical assistant, the materials illustrator 
and a sample of teachers in the project. 

2. The evaluators examined management techniques 
used in the project including: 

a. The memos and reports of the staff to outside 
consultants, to school administrators and to 

• project teachers; 

b. Worksheets, schedules and decision summary 
forms developed by the Director with consultant 
assistance from the evaluators; 

c. Financial and activities schedules; 

d. Activities at orientation, inservice training 
and dissemination meetings. 

3. The evaluators compared activities, results and 
timetables with project activities. 

B. Evaluation Results 

1. The evaluators noted three major management diffi- 
culties which would have to be at least partially 
solved to provide an effective management capability 
for this project: 

a. The variety of activities (revising scripts, work- 
books and tapes; producing tapes and printing 
workbooks; communicating with consultants 
located at various West Coast locations; coor- 
dinating schedules; planning and implementing 
field testing in several county school districts; 
monitoring classes and communicating with pro- 

»: ject teachers; directing project staff activities 
and providing general financial management) 



made unusual demands on the Project Director's 
time that placed a premium upon effective 
scheduling of her work and upon coordination 
and follow -through with her small staff. 

b. The Project Director is a leading expert in 
auditory perception. Both her interests and the 
need to save money in the project projected her 
into ongoing production, monitoring and class- 
room involvement which took time away from 
broader, effective management activities. 

c. As noted in the interim report, the project con- 
tinued to be underfunded. The need to cut activ- 
ities, reorder priorities and juggle budgets was 
a time consuming effort eating away at time 
that could be spent in more productive and posi- 
tive management. It also threatened effective 
completion of project activities. 

The Project Director consulted with the evaluators 
and formulated several methods for effective sche- 
duling of her time and the time of her staff. 

a. The Director and the technical assistant adopted 
a decision summary form (developed with the 
assistance of the evaluators). The form was 
used for both individual and group decisions. 
It provided a convenient way of writing down a 
problem together with its solution. It also pro- 
vided a method for follow-up by indicating cri- 
teria to be used, date of accomplishment for 
various tasks and staff member assigned re- 
sponsibility for each task. The Director was 
enthusiastic about the form and used it faithfully. 
It improved the Director's management perform- 
ance by more effectively scheduling time and by 
assuring completion and follow-up of management 
decisions. 

. b. The technical assistant, as noted in the interim 
report^ was a competent professional who was 
personally well organized. She lifted many rou- 
tine tasks from the Director's shoulders. The 
Director recognized this and used her to monitor 
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school activities^ to evaluate workbook and 
test effectiveness and to coordinate many pro- 
ject activities. In d>ing this, the Director 
assured more control and follow-up of project 
activities than in the previous year. The 
Director was also given more time for broader 
management activities without losing contact 
with the day-to-day project activities. 

In the early weeks of the project, the Director 
personally handled the complex task of coor- 
dinating the work of the consultants in revising 
tapes and workbooks. The difficulty of coor- 
dinating work at various locations among a 
group of diverse professional people required 
the Director's time. She recognized this and 
devoted most of her time to these problems 
during the early weeks. The evaluatbrs were 
impressed with her pacing of her time, her 
continuing follow-up and communication, and 
her ability to handle the myriad details involved 
in these major production tasks. She still in- 
volved herself personally too much in these 
activities (as noted below) but generally she was 
effective. The most specific indication of her 
effectiveness was the completion on time of all 
revisions of workbooks, tests and tapes to meet 
very high performance criteria. 

One measure of effective scheduling of staff 
time can be derived from classroom teacher 
perception of project management. The evalu- 
ators attended project teacher meetings, 
visited project schools and evaluated results 
from a pre-post questionnaire given to teachers. 

1. In interviews most teachers in both class- 
roonis and learning disability clinics felt 
the Project Director and the technical 
assistant were available and helpful. The 
teachers were able to reach the project 
staff and they received visits from the 
staff. They felt their suggestions were 
being taken seriously. (The evaluators 
agree that this was the case. We examined 
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many notes taken by the staff on oral 
teacher comments and from teacher 
comments made on returned student book- 
lets. These were discussed and some 
have been incorporated into next year's 
work, ) 

Some teachers noted a lack of inservrce 
training, but this was to be expected since 
almost none was given this year to assure 
that children learned from self-pacing 
materials rather than from teachers. 

The pre-post questionnaire given to the 
teachers gives some insight into manage- 
ment effectiveness. If the teachers agreed 
in understanding project objectives, if they 
agreed that the project provided new ap- 
proaches to teaching and if they generally 
rated the project as successful, it should 
indicate that not only were the techniques 
and materials successful, but also that 
the project's management was effective. 
The results from the questionnaire appear 
in Table I. 
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The cvalu»tor» drew the following con- 
clusions with regard to project manage* 
ment from this table: 

a. The project staff was successful in 

conununicating the basic listening 
objective of the project to the class*- 
room teachers and to the teachers of 
learning disability clinics. However, 
the fusion of auditory perception with 
its impact on improving reading was 
communicated strongly only to the 
teachers of the learning disability 
clinics* These latter, of course, 
are especially aware of reading prob- 
lems because of the nature of Iheir 
remedial work. The figures suggest 
that better communication of objec* 
tives with regular classroom teachers 
would be beneficial* 

h. The teachers in both groups clearly 
understood the emphasis was not on 
teacher directed work, but rather on 
a combination student use of tapes 
and workbooks* Several classroom 
teachers emphasized the 'learning by 
doing*' method in the pre questionnaire* 
Communication of this method of 
teaching was crucial to project success. 
In this respect the management and 
communication process was notably 
successful* 

c* The evaluators are puzzled that so 
many teachers in both classrooms and 
learning disability clinics felt the ob- 
jectives/methods used were similar to 
those used in language development 
classes* Ttiis is particularly puzzling 
since some teachers went on to indicate 
differences in detail* We believe the 
fault is in the phrasing of the question. 
Three learning disability clinic- special-* 
ists indicated in the post questionnaire 



that the objective! were tiznilar, but 
that the methods were different. The 
objectives at most educational pro> 
grams at the primary grades is to 
teach basic tidllft. This program is 
no dififerent in that respect. But the 
method, through auditor/ perception, 
is different and that difference was 
caught by some of the teachers mosf 
mvolved in special programs for re- 
medial work. In the seu£0 tiiat many 
of the teachers could not make tfie dis- 
tinction, project management was not 
successful in a basic communication 
task. 

This failure is farmer exemplified by 
the commeBt« of dxe teachers. Itiey 
really could not cgree on the way in 
which objectives or methods were dif- 
ferent from those normally used. 

Most teachers were not in the project 
last year. Their pre-post assess- 
ments of inservice training (really 
comnriunication since no formal in- 
service training was given) and man- 
agement was quite pure. Communica- 
tion generally improved during the year 
with all teachers givirig a rating of 4 or 
5 by year's end. Program direction or 
management was generally regarded as 
effective at the beginning of the year 
and even more so by the end of the year. 
Theie is, however, some evidence that 
while learning disability clinic teftchers 
regarded prograr^s. direction as effcr.- 
tive in both questionnaires, they were a 
bit less enthusiastic in the post test. 
The evaluators suggest that learning 
disability clinics are especially sensi- 
tive to the need for helping children 
with b'iSic skill r i^oblems. They may 
have entered the i^j ogram with elevated 
expectations of the project, its mater- 



ials and its inservice training* By 
the end of the year, while generally 
favorable, they were not quite as 
euphoric in their expectations* 

e. The project continued to be under- 
funded* The evaluate rs believe this 
hampered many of the efforts made 
to improve program management. 
The staff was too small and both the 
Project Director and the technical 
a:ssistant were required to take care 
of many small details. This took 
away from effective planning time* 

The evaluators observed the hours 
the Dlrector^iiad to spend in cutting 
expenditures and reorienting activities 
to meet budget restrictions* A major 
section of the program had to be de- 
leted and many follow-up and evalu- 
ation procedures had to be dropped. 

Despite this the Project Director was 
resourceful in using slender resources. 
Her use of volunteer time from con- 
sultants and her use of district and ad- 
is^dvisory committee personnel indi- 
cates she tried to gain the maximum 
help possible with the minimum expen- 
diture of funds. 

From these data the evaluators conclude the Project 
Director was at least partially successful in better 
time scheduling and staff coordination and in involv- 
ing herself less in project details and more in plan- 
ning. Continuing effor.ts-in-these areas would be 
beneficial but they will be limited because the third 
difficulty-*underfunding--remains a principal prob- 
lem. 

Given the limitations described, the improvement in 
projc?ct management is considerable.. The view of 
the project teachers that management for the pro- 
ject was effective is the final and best source of 



evaluation since they experience the results of both 
good and bad management directly. 

To complete the project evaluation for fiscal year 1970-71^ 
witii reference to the effectiveness of both product and pro- 
cess. 

A. Evaluation Activities 

1. The evaluators interviewed the Project Director, 
assisted in preparing the evaluation design for the 
Continuation Proposal, end reviewed the .End of 
Budget Year Report.- 

B. Evaluation Results 

1. The Project Director, with a very small staff, com- 

pleted an evaluation of the fiscal year 1970-71 em- 
phasizing product evaluation. She used consultants 
to .help measure the impact of the first year upon 
the students in the project. This aspect of the eval- 
uation was quite complete. It is not withitrthe-ob- 
jectives of our evaluation to repeat the findings. 
Rather, the evaluators note that the Director en- 
gaged competent statistical help and produced a 
complete product report. 

2. Some attempt at process evaluation was made by the 
Director. It is difficult to assess the effectiveness . 
of one's owi procedural activities. Recognizing 
this, the Project Director engaged Education/ 
Research, Inc. /to do an outside process evaluation 
for 1971-72. : 

, 3. The evaluators conclude that this procedural objec- 
tive was met. 

To develop and produce revised instructional materials to be 
used in the field test phase during the second year of the 
project. 

A. Evaluation Activities 

1. The evaluators interviewed the Project Director and 
her staff with regard to materials revision and pro- 
duction. 



2. The evaluators reviewed decision summary forms, 
minutes of meetings, reports and letters dealing 
with tile revision and production of instructional 
materials. 

3. The evaluators compared illustrations, work- 
* books and scripts for tapes for the first and the 

^second years of tiie project. 

4. The evaluators compared activities with the objec- 
^ tives and time schedule of the project. 

B. Evaluation Results 

1. As noted above, the Project Director was espe- 
cially conscientioas and successful in coordinating 
tiie revision and production activities of the widely 
scattered consultant staff. Because the staff were 
widely scattered alo ng the W est Coast and because 
each consultant had a busy schedule of his own, 
joint meetings were held to a premium. Instead, 
the Project 'Director made several trips to the con* 
sultants and acted asa liaison between them. The 
voluminous correspondence and the heavy tele- 
phoning necessary for this coordination was an 
extraordinarily time consuming thing. However, 
it could not be helped and was the best way of 
seeing that tiie product was completed. 

2. The evaluators were impressed with the flexibility 
of the Project Director in accepting and evaluating 
suggestions made by classroom teachers in ^last 
year's project and by the outside consultant. At 
the same time, her own expertise in the subject 
area came through in her own thorough sugges- 
tions. Sometimes, differences of opinion led to 
disagreements on revisions. When that happened 
the Project Director seemed to prevail. 

3. The tiioroughness of the revisions and the in-depth 
planning of the lessons also impressed the evalu- 
ators. The evaluators listened to discussions 
between the workbook illustrator and the Project 
Director on the minutest detail of illustration. If 
an illustration or a script was changed (and the 
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changes were extensive) it was typically gener- 
ated by: 



a. test results showing poor results in that 
area, 

b. comments on the workbooks by project 
teachers, 

c. observations of the Project Director on ^ 
visiting classrooms, 

d. suggestions from the consulting script 
writers and coordinators. 

These were truly informed comments and indicate 
that the revisions were carefully planned to further 
the instructional objectives of the course. 

4. The evaluators have been impressed with the 
professionally high standards set in both project 
years for materials production. The workbooks 
were worked over many times for clarity, inter- 
est and high quality. Each workbook is colored 

a diiEferent color. Many discussions, too, place a premium 
on choosing tiie right colors to create the appro- 
priate mood and interst. 

The tapes were made to the highest distortion- 
free quality standards possible. This care ex- 
tended to voices and quality of earphones and 
tape recorders in the school. Since most . 
school recording equipment was not very high in 
quality, many distortions occurred despite the 
quality of the tapes. 

5. The evaluators conclude that the procedural objec- 
tive for tile development and production of revised 
instructional materials was met e^ciently, in 
conformance to the highest production standards, 
and in a way that assured improvement of Hie 
materials to meet weaknesses discovered in the 
project's first year. 
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To conduct field test of revised APT materials for both 
treatment and control groups. 

A, Evaluation Activities 

1. The evaluators interviewed the Project Director 
and her staff, some consultants and most of the 
regular classroom and the learning disability 
clinic teachers in the project. 

2. The evaluators reviewed decision summary forms, 
minutes of meetings, reports and letters dealing 
with field testing. 

3. The evaluators reviewed teacher comments on the 
field testing phase and the section of the pre post 
'questionnaire dealing with field testing. 

B. Evaluation Results 

1. .The field testii^ was conducted according to 

schedule with two groups of project students and 
one group of control students. The target popu- 
lation consistefi of two groups. In Group A 
there were 152 children in six second grade 
classrooms scattered throughout Alameda County. 
In Group B there were 39 children in four learn- 
ing disability groups in ^e Fremont Unified 
School District. These children came from 
schools throughout the district and were enrolled 
in grades 2 through 6 in regular classrooms. 
All target children received special trainii^ in 
auditory perception with the revised instructional 
materials. 

The control group consisted of two sections. One 
group included IS^Lsecond graders in various 
Alameda County schools. The other group in- 
cluded 37 students in grades 2 through 6 in learn- 
ing disability group3. The children in the control 
groups were originally supposed to listen to stories 
on tapes on a regular schedule, but not receive special 
training in auditory perception. Due to funding 
restrictions, this feature of the program was cut* The 
control group received no listening instruction 



at all* Both experimental and control groups 
received pre-post testing in auditory perception 
skills» oral reading skills, and delayed memory. 

The evaluators attended an orientation meeting . 
for project teachers at the beginning of the year 
and an assessment meeting at the end of the 
year. The evaluators also read notes made by 
the Project Director and the technical assistant 
of numerous visits and phone conversations 
with the project teachers. The project staff 
was not to train the teachers in materials use 
since they. wanted to limit teacher intervention 
and test materials only. However, the meet- 
ings and contacts were necessary to orient 7 ~ 
teachers to project objectives, to answer tech- 
nical questions and problems and to assure the 
field testing was carried out adequately. In 
this respect the project staff contributed notably 
to the field testing. 

The evaiuators noted the considerable complex- 
ity of this kind of field testing. Some practical 
problems such as coordination, orientation, 
the physical distribution and collection of the 
instructional materials, the collection and assess- 
ment of feedback information from project 
teachers, on site monitoring and pre-post testing, 
were solved with dedication and imagination by 
the project staff. 

How#^ /er, other problems could not be adequately 
solved and these will have to be taken into ac- . 
count by the product e valuator. These included: 

a. The control group appeared to be better 
. educated with fewer skill problems. The 
^group appears to have been selected from a 
socially and educationally different group of 
students than the target children. This was 
noted in the interim report and its effect on 
testing was noted by a testing consultant in 
May, 1972. This problem is discussed in 
greater detail in the evaluation of the proce- 
dural objective related to product evaluation. 



The pre-post testing instruments were 
not as valid for the project as they could 
be. The GUmore Reading Test (Form B) 
needed revision and updating. It needed,, 
in the testing consultant's opinion, some 
modification of scoring methods. The 
Lindamood Auditory Conceptualization 
Test needed more specific, instructions 
and a less redundant second section. 
Finally, the testing itself was so complete 
that combined with all the other school 
testing, it may have produced a kind of 
"test weariness" which may have affected 
the results. These testing problems. will 
be discussed in greater detaU by the pro- 
duct e valuator. 

The evaluators in interviews and on site 
inspections concluded the teachers were 
varied in their use of the materials, in 
their enthusiasm and in their general ap- 
proach to the project. While the majority 
of the teachers favored the project, they 
had received no insexvice-training and 
they developed their own interpretation of 
how much intervention they should use. 
Each classroom also presented a unique 
environment for teaching. Some had - 
better tape recorders than others, some 
were quiet while others were on busy 
streets, etc. In an auditory perception 
program these differences were more im-* 
portant to program success than would be 
the case with other basic educational skills. 

•*^Some concept of the variability described 
above may be obtained from the evaluation 
staff's report of several on site visits. The 
observation report submitted by the process 
evaluators to the Project Director on 
April 18, 1972 is reproduced on the following 
pages. 



April 18, 1972 

AUDITORY PERCEPTUAL TRAINING 
Site Observations 



Observation #1 

LDG Clinic Expeximejital Group 
3/23/72 „j. 

According to the teachers, auditory perceptual training 
at this school is done twice a week, thirty minutes each time. 
There are two groups of ten each, one experimental and one 
control. On the day of the observation, five children received 
the taped lesson, which was the first lesson in Set Four. The 
participating children ranged from the second through the sixth 
grades^ - 

The class met in a separate room free from outside 
distractions. They seemed interested and ready to work. The 
teacher began the session in a relaxed, informal manner casually 
passing out the materials. The children were alerted that-the 
tape would soon begin by ihe teacher's question: "Everyone have 
their listening ears on? Occasion^iUy, the teacher walked around 
the working students. This might have been a slight distraction. 

The voice on the tape recorder asked a number of questions. 
Sometimes the children tried to respond, but couldn't b ecau se 
there wasn't enough time. Often they did react non-verbally to 
the voice on the tape, possibly tipping off other students as to 
the correct response^ For the most part, they seemed concerned 
over making correct responses. This evaluator wondered 'if the 
tapes were not programming the children to accept correct responses 
as the only valuable data in the learning process. The use of the 
color red as the marker for checking responses might be 
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additional reinforcement in this regard. 



Wheu the students finished, the teacher collected the books 
and the pencils. There was no discussion. The students proceeded 
to another room to beginrother work* The teacher indicated that^ 
LDG second graders experience some real difficulty witii sound 
discrimination and voice patterns. Since this was-the initial 
observation, this evaluator took the next lesson (the teacher 
was previewing) to get a closer idea of the process the children 
actually experience. Of interest was page 2 (Thinking and 
Talking, 4.2). The problem concerned ''has been wet, is wet, 
and will be wet. " Both the teacher and myself were struck by 
the inconsistency between the words and the picture since "Circy*' 
is using an umbrella to avoid getting wet. We both agreed that 
this item might need revision. 

By and large, the teacher seemed pleased with the program, 
particularly since many time-consuming clerical tasks have been 
eliminate^ leaving only a largely administrative function. 

Observation #2 

LDG Clinic Experimental Group 

4/4/72 ^ 

Initially, the teachers were interviewed. They have nine 
students in their group, but they are scattered throughout four 
periods. Consequently, the students receive the tapes in groups 
of two, three, three, and one. According to one teacher,, many 
of the ^tudents are using APT as "therapy," They frequently 
talk bax. c to the tape recorder and many of the conunents are 
quite Jic stile. ^^The teacher remarked, "If Circy ever walked in, 
the kids would murder him. " The teachers stated that APT is 
good for learning to read. Many supplemental activities would be 
necessary for APT to actually help in reading improvement. It 
occurred to this evaluator that the teachers might dislike the APT 
themselves, possibly transferring a negative attitude to the children. 

Two girls took the taped lesson. About ten feet away, four boys 
were doing oral group work. This appeared to be a distraction as 
the teacher had to continually "shh" the boys so the girls could hear 
the tape. Both groups seemed to be losing in this situation. The 
lesson was on ^Svhen things happen. " The teacher discussed the idea 
thoroughly with the students prior to beginning the tape (prepping? )• 



The teacher sat in front of the students » approximately two feet 
away from their desks. This was so close it, too, seemed a 
distraction. Frequently, the teacher stopped the tape recorder 
for discussion. Also, the speed was controlled so the children 
would have additional time to consider their responses. Finally, 
the teacher occasionally repeated a question. The extent of 
teacher support seemed too great, possibly creating a significant 
variable in the case of this class. 



Observation #3 

Second Grade Experimental Group 
. 4/4/72 

This class has 29 students. According to the teacher the 
children really enjoy the tapes. Daring the session, the ease 
in which the entire APT process was handled seems to corro- 
borate this statement. The teaclier stated that she has observed 
a positive carry-over from the APT to reading improvement 
*'since it correlates with reading skill development. " Also, the 
teacher thinks it is particularly valuable for learning to follow 
directions. 

The class was quite relaxed and seemed to anticipate the 
lesson with pleasure. The teacher passed out the booklets and 
only said the following: a) "Put your names on the booklet*'; 
b) 'Watch your behavior so everyone can have the same chance. '' 
She quietly moved about the class during the lesson, only 
interrupting one time to prepare the class for a different marking 
technique on page 4 (Lesson #4.4). Some students did appear to 
tip off the others as to the correct response; others were watching 
their fellow students. (Is this class size manageable?) 

Observation #4 

Second Grade E^^perimental Group ^ 

4/6/72 

There are twenty six students in this group. The lesson today 
is 'Double Talking" (4. 8), The teacher feels it is a particularly 
difficult lesson. The atmosphere in the class is quite informal 
and relaxed. After the class has settled, the teacher introduces 
the lesson by asking what the lesson is about. Students reply: 
''Double- Talking. " She says that "Today's lesson is difficult. " 
In this case, the teacher may be creating a self-fulfilling prophecy 



situation* 



The class is particularly noisy during the tape. They 
vocally respond to the checking part of Hie tape witii *'y^hs*' 
and **boos'\ Again, the tapes may be reinforcing the '^right 
answer syndrome. " One student stops working apparently due 
to frustration. One child is reclining in a box on the floor. The 
box covers her right ear. * She pulls a cushion next to her left ear. 
How can she hear? 

In this lesson, it is particularly hard to distinguish the 
competing messages. This may be due to the fact that both 
voices are from males. Not only do the students have to 
distinguish a competing message, but they may also be having 
to discern between similar voice qualities. The competing 
messages i£ easier when one voice is male, one female. 

Observation #5 

'Second Graide Experimental Group 
4/6/72^ 

This class has 28 students. Again, the lesson is ^^Doubles- 
Talking" (4.4). A number of problems occurred during „this 
observation, although the time of day could be a problem, i. e. , 
right^ after lunch. 

According to the teacher the students are quite frustrated 
with the tapes. They are hard. She, too, feels that there is 
little carry-over to readitig improvement. The competing messages 
''ju?t help students to tune out classroom noise while they are 
reading." Frequently, the teacher has to interrupt and encourage 
although "we^re not supposed to. " Finally, she feels the tapes 
lack variety. They are too mechanical and repetitious she says. 

During the session, the teacher refers, to the tape 2.S a "test. " 
She corrects herself. When she introduces 'Double- Talking", 
students are vocally negative. As with the class at the 
students respond with "yehs" and "boos" during the checking part 
of the tape. Too, many are tipping off each other as to the correct 
response. One student is cheating. She puts the answer first, then 
the correct response. This is interesting because she knows that I 
know she is doing it. Could she be responding this way to get needed 
attention? On page 2, a student asks, "What^s a patch?" One student 



is sliding back and forth in front of the tape recorder each time 
a question is asked, thus blocking the sound. Once again, the 
competing quality of voices (two males) appears to add to the 
inherent difficulty of the competing messages. 

The teacher is very aware of the students' acting out 
behavior. She questions them. One student says they are 
misbehaving because a visitor is in the class. In fairness 
to the teacher, she's probably right." Also, there was an 
upsetting incident today during the lunch period so that this 
session is probably not representative of the class' usual 
performance. 

These comments suggest the teachers are 
favorable to the program and trying hard to do a 
professional job of field testing in a classroom 
situation with a large number of variables at 
play. The on-site visits were completed during 
the use of Set IV of the materials. This is the 
only set in which students did not meet project 
criterion for growth. This failure may well 
have influenced other observed variables such 
as overt attention. and interest. 



4. The evaluators were impressed with the care 
given to reporting on individual student progress 
through interim review tests. Individual profiles 
on each target student were kept in the project 
office. The Project Director and.the technical 
assistant painstakingly chartered each child's 
progress and conferred with teachers over any 
unusual changes in student progress. This care 
should be reflected in an unusually in depth pro- 

/ ' duct. evaluation report. 

5, The evaluators also noted the care with which 
teacher comments for each lesson were recorded 
and analyzed for possible future revisic^-^ of 
techniques or instructional materials, xtie tech- 
nical assistant,, for example, compiled a long 
summary of teacher comments with analytical 
comments from the Second, Third and part of the 



Fourth Lesson Sets* Comments were made 
on pictures, lesson strands, sentences, voices 
on tapes, etc. , which confused or upset students. 
Comments on student interest or lack of interest 
were noted. An example of the detail to which 
this analysis went is indicated in the. following 
excerpt from the summary* 



**Lesson2«l, Page 1: Teachf-^ comments: Many 
students did the opposite of what was asked on 
the tape recorder, 

^'Many of the students were copying from each 
other. 

**Page 2: Easier to do; students could relate 
to topics. On number 8, students make faces 
at the sentences. (I don't like spinach). Row 9, 
many students smiled and said 'yes' (Wouldyou 
like some chocolate ice cream? ). Row 10, 
students mimicked the voice back. 

"Dr. Witkin has a note, a question beside this, 
'should we build this in on the tape? ' 

"Student comments: Page 2 seems to be the hard- 
est. Some thought it was boring listening to the 
same thing, i»ome thought it was fixn. Some 
thought page 3 was either hard or fun or tricky. " 



The evaluators believe this care in analysis rep- 
resents one of ^e best results of the field testing. 
It assures that the teachers' comments are ade- 
quately included in evaluation and in any revisions 
made next year. 

The teachers gave a vote of confidence to the in- 
structional materials both when introduced to 
the materials and at the end of t!ie year* Almost 
all teachers in both experimental groups found 



the materials and the tests developed for the 
materials to be effective (r«;;ted as a 4 or 5 on 
a five point rating scale with 1 as low and 5 as 
high). 

The evaluators conclude tiiat this procedural 
objective was completed adequately* The pro* 

' ject staff conducted a complete and detailed 
fisld tZ9U They recognized problems that ' 

-arose and will try to assess results with those 
problems in mind* They have already worked 
on ways to overcome some of the problems in 
the future* Since teacher intervention will be 
allowed, they plan more inservice training and 
this should decrease teacher variability* Test 
modification and more careful selection of ex- 
perimental and control groups will improve the 
field testing next yean 
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To conduct a feasibility study of the use of rate controlled 
(compressed) speech for improved listening and reading 
rate and comprehension. 

A. Evaluation Result 

1. This objective was deleted from the ^project with 
permission of the appropriate state educational 
agencies because the folding finally approved 
was less than requested. This required the cut- 
ting of some activitie The Project Director 
decided it was more important to complete the 
work on the materials developed in the project's 
first year than to drop some of that work and 
introduce new' elements. The evaluators con- 
clude the Director made the right decision. 

To conduct a process evaluati^jrn of the project's activities. 

A. Evaluation Activities 

1. The evaluators reviewed the process evaluation 
activities in relation to the objectives and evalu- 
ation activities planned. 

2. The evaluators interviewed the Project Director 
and reviewed correspondence between the 
Direct^Jr and the evaluation team. 

B. Evaluation Results 

1. Most major evaluation activities that were planned 
were completed. These included: 

a. development of forms and a questionnaire 

b. periodic interviews with the Project 
Director and her staff 

c. interviews with project teachers 

d. comparative review of materials developed 
" for the first and second years 
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e. review of all major correspondence » 
minutes of meetings and memos 

f. review of teacher comments on lessons 

g review and analysis of pre-post teacher 
questionnaires 

h7~ on site visits to classrooms in the project 

i. preparation of on-site visit report 

j. preparation of interim process evaluation 
report 

k. feedback to the Project Director 

1. preparation of final process evaluation 
report 

The e valuators we):e able to assist the Project 
Director in better project management through 
feedback and discussion on project activities 
and through development of a decision summary- 
form. 

The evaluators were able to develop a good 
picture of the effectiveness of the project's 
procedures through the unusually thorough 
documentation submitted by the Project Director 
and her staff. 

The evaluators were unable to provide as much 
feedback as the Project Director would like or 
as indicated by the Servo-evaluation model pre- ; 
sented in the Continuing Application. The bud- 
getary restrictions were responsible for this 
failure. The evaluators xontinu^ to experience 
in many projects a failure ko provide adequate 
funding lor a complete and continuing evalua*- 
tion. Within the limits of the budget, a surpris- 
ingly complete evaluation has been made. The 
evaluators donated spme time and this helped 
to balance some budget problems. However , 



\ 



tfie evaluators are very disturbed to note 
further budget restrictions in the overall pro- 
ject generally and in the evaluation activities 
specifically. The evaluation for the last year 
should be the most thorough of all three years. 
We suggest additional grant money for evalu- 
ation might be applied for through other agen- 
cies. 

7. 0 To conduct a product evaluation of tiie project. 

A. Evaluation Activities 

1. The evaluators interviewed the Project 
Director and her staff. 

2. The evaluators reviewed corxespondence, 
minutes of meetings, notes and reports relating 
to product evaluation. 

B. Evaluation Results 

1. As with process evaluation, this activity was 
underfunded. Within budget restrictions, the 
product evaluator is providing a remarkably 
complete statistical report. His access to com- 
puters and his willingness to give much of the 
resource necessary for a full statistical report 
is commendable. Again, next year, however, 
this aspect of evaluation will be underfunded. 
Additional funding for product evaluation should 
be sought. 

2. The product evaluation, while generally success- 
ful in its procedures, failed in one notable 
respect. Both due to inadequate time and budget 
and to a failure in understanding by project 
principals and teachers, the project management 
failed to control sufficiently the selection of 
control and experimental groups. 

The Project Director planned not only to compare 
experimental groups in regular classrooms and 
in learning disability clinics, but also to compare 
experimental groups with control groups drawn 

f " ' ' ' 
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from both groups. The control groups 

would receive no special auditory perception 
training, but they would be pre- and post-tested 
for tiiese skills. The control groups were 
generally selected from better readers. The 
testing consultant noted in his May 30, 1972» report 
to the Project Director, "I lere was a pervading 
feeling, without adequate proof, that the two groups 
had been arranged and were not randomly selected. 
The experimental group, almost without fail, 
scored lower as a group and were worse readers 
than the control group ..." 

Further questioning of principals and teachers 
indicated that in one-third of the experimental 
classes, the advisory committee and/or the 
teachers consciously placed low achieving students 
in them so they would benefit from the program 
The teachers became aware of the difference this 
made when the dispr *ty between groups was 
brought to their attention in March, 1972. 
Later, the Project Director discovered that 
many school principals had assigned students 
to classes generally to preserve homogeneity 
of reading ability. Lower students tended to 
congregate in experimental classes and better 
students into control classes. 

It is clear that the processes used to assure 
adequate selection of a control group were 
either not developed or not followed. As noted 
above, the evaluators suggest underfunding was 
prixx^rily responsible for some lack of control 
over product evaluation activities. 

3. The evaluators conclude that despite the appar- 
ent failure to provide for a randomly selected 
control group, the product evaluation will be 
completed on time and will provide a surprisingly 
complete statistical evaluation of the effec^^ of the 
auditory perception techniques and materials on 
improving project children's reading ability. 

To provide for dissemination of the project results. 

A. Evaluation Activities 



1. 



The evaluate rs interviewed the Project Director. 



Z. The evaluators reviewed correspondence and 
reports sent to individuals and districts in- 
quiring about the project. 

3. The evaluators reviewed publicity releases on 
the project. 

4. The evaluators reviewed the dissemination 
activities planned for the project. 

Evaluation Result s 

1. The evaluators conclude that the project results 
will be widely disseminated because of the 
following: 



a. The Project Director is a widely known 
expert in auditory perception. The con- 
sulting stafif for materials development 

* is also widely known. Their joint activi- 
ties are already known in many areas due 
to publicity releases in the local county 
school district paper and through cover- 
ages of speeches and panel discussions 
the Project Director has contributed* 

b. The Project Director has already shared 
many project results with individuals and 
districts who have written to inquire about 
the project. Copies of tiiis correspondence 
are in the project files. 

c. The Project Director is an experienced 
educator and project director. Her work 
as a PACE Center administrator and in 
other projects has given her experience 
to plan for wide dissemination of the pro* 
ject reports to all appropriate state and 
local educational agencies. 
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Indicate clearly the success or failure of each objective 



A. Except for procedural objective 5/0 which was cut from the 
the project because of underfunding, all procedural objec- 
tives were successfully met. An in depth analysis of the 
degree of success of each objective is included in the analysis 
of tile findings for each objective included in question 2. 



Can the finds be generalized, or are they applicable only to 
the groups served by the program? 



A. Because this is the second year of a three year experimental 
project applying auditory perceptual training to improving 
reading, the results can be applied only to the^group served 
by the progrsun. At the conclusion of the third year next 
summeri—the resiilts shoiild have broad applicability to the 
teaching of auditory perception skills and the application 
' of those skills to improving reading for a wide and varied 
group of students. 



What were the causative factors for xmmet objectives? 

A. Only procedural objective 5. 0 (To cotiduct a feasibility 
study of the use of rate controlled— compressed — speech 
for improved listening and reading rate and comprehension) 
was unmet. The only reason it was not completed related 
to the fact that only a portion of the project was approved 
for fiinding. This objective was cut due to lack of funds 
with the approval of applicable state and local educational 
agencies. 
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What are the other important findings which were not anticipated ? 

A. AM findings (anticipated and unanticipated) are discussed in 
depth in the answer to question 2. 



SUPPLEMENTARY EVALUATION REPORT 



By 

BELLE RUTH WITKIN, PH.D. 
PROJECT DIRECTOR 
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SUPPLEMENIRRY EVALUATION REPORT 



In addition to the two external evaluations which were reported In the 
previous sections^ the project director and staff performed extensive data 
analyses and conducted ongoing evaluations in the classrooms. These activ- 
ities were used as feedback for management, to correct Instructional and 
testing procedures, and for various kinds of decision making. Considerable 
assistance was rendered by graduate students in educational psychology at 
Cal-State University, Hayward, under the direction of Dr. Thomas E. Whalen. 

The following data were gathered and analyses performed by the project 
staff: 

1. Analysis of class progress — All lessons and Interim Review Tests 
were corrected and scored by the staff. Profiles of achievement were 
constructed for each class separately, and composite profiles for Groups A 
and_B separately. 

2. Analysis of Individual student progress — All pretests and post 
tests were administered and scored by staff, and individual profiles were 
constructed for all students. These profiles were derived from standard 
scores computed around the pretest means. Samples of these will be dis-* 
cnssed later. 

A stratified random subsample of 5^ students — ^5 from Group A and 9 
from Group B — was studied during the year. Stratification was based on a 
9-cell matrix of low, average, and high reading listening skills. Individ- 
ual lesson and IRT profiles were constructed for each of these students. 
Examples will be discussed later in this section. 

3. Classroom Observations and teacher feedback — Continual observa- 
tions of the field test of the materials and feedback from teachers and 

students were used to modify the program and to design the extensive inj^ 

service training for the third year. These observations also furnished 
data which helped explain why experimental group mean gains were not sig- 
nificantly higher than control group mean gains. 

^. Analysis of the CAPT — An extensive analysis was made of the 
CAPT, for purposes of revision and use in the third year of the project. 
This was done because the test is^more comprehensive than published tests 
in auditory perception, it is easy to administer, and has wide application 
beyond the scope o£ this project. 

The CAPT was also administered in spring 1972 to first, second, and 
third grade classes not participating in the APT project, in order to 
gather normative data. 

5. Listening and reading survey — In order to obtain accurate data 
on the economic and educational background of the families of the students, 
a listening and reading survey was sent to parents of both the experimental 
and control group participants. 
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6. Data from additional project sites -- Liaison was maintained with 
two project sites out oi: the'^county, which tried out the first set of the 
materials at their own expense. 

... oOo ... 



1. Analysis of class progress in the APT program 

The student behavioral objectives for the four units of the program 
are listed in Appendix B. A description of the way in which the lessons 
were given is found on pages 15 and 16, above. 

Scores on each of the 39 lessons and the four Interim Review Tests 
were recorded for each student. Tabulations were made showing the per- 
centage of students reaching criterion on each lesson and IRT, as well as 
the mean percent correct. Analyses were made for each class individually, 
and for composite Groups A and B. 

Criteria for the lessons, based on performance from the first project 
year, had been set at 80/80. Early in the program it was found that this 
criterion was too high for some classes, for the following reasons. In 
the first year, lessons were administered to students in groups of 5 to 
15, and a certain amount of teacher intervention was permitted. In the 
second year. Group A classes averaged 28-32 students taking the lessons 
all together, no teacher intervention was permitted, the students took twice 
as many lessons as in the first year, and many lessons had been revised to 
provide more challenge. 

Appendix C contains class profiles showing the mean percent of items 
correct for the lessons and IRT's. Figures 1 and 2 show composite class 
profiles on the four sets of lessons for Group A students in regular sec- 
ond grade classrooms. Figures 3 and »♦ show composite class profiles for 
Group B, students in learning disability clinics. 

In spite of variations in performance from lesson to lesson within 
sets, both A and B groups reached criterion levels on the first three 
Interim Review Tests. On the fourth set of lessons, however, both groups 
had much more difficulty, although Group B did cons.i'derably better than 
Group A. Table 16 in Appendix* A summarizes the Interim Review Test data 
for the two groups, and shows that students made satisfactory progress for 
most oi the program. 

Early in the year it was found that the individual classes differed 
tremendously in their ability to handle the lessons without teacher inter- 
vention. Separate analyses were made for each class, and their progress 
charted. Fi«?ures 5, 6, and 7 show a comparison of scores reached on the 
lessons and test of Set 1 by the six Group A classes; Figures 8 and 9 show 
progress on Set 1 for Group B classes. The data for Group A are also summa- 
rized in Tables 17 and 18 ir. Appendix A. Similar analyses for Sets 2, 3, 
and 4 are on file in the project office. 
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Although the general shapes of the profiles were similar from class to 
class, there were striking differences among classes. It is clear that 
these differences must be taken into account in using any program such as 
Jhe - TTheJe were great initial differences among the classes in cultural 
and . Lmic background, noise environment, reading ability, and ability to 
?ole .iHistraction and frustration. Two of the teachers were also absent 
for illness, one for an extended period. 

In addition, the teachers in Group A had been asked not to assist the 
children, except to answer questions regarding P'^jcej"!^' .J^^^^^^J^ °lat 
intervention was built in deliberately, in order to determine exactly what 
the audio lessons would do without individualization or adaptation to 
differing needs. 

fi.inn.arv and reg^ndations ; On the basis of the Jo^^egoing analysis, 
maior changes in the program will be made for the third year. (1) Several 
Tessons ha?e been revised to bring the tasks within range of average second 
graders and to overcome procedural problems. (2) Teachers will receive 
Txlenllvl inservice in methods of adapting the program to ^"dividual needs 
through prescribed intervention and branching procedures. (3 The program 
wiU^e adapted to different class sizes and environments. (H) More flexi- 
bility will be available for teachers and students in using the program. 

2, Analysis of individual st udent Drogre>»« ^n the APT program 

Profiles showing performance on all pretests and post tests were 
constructed for each student. In addition, individual progress charts on 
lessons and IRT's were kept for the subsample. 

Figure 10 in Appendix D show^ the way in which students were selected 
for thf subsample. Five students from Group A experimental classes were 
randomly chosenliom each of the 9 cells of the matrix. Nine students 
Jwm Group B were randomly selected from the total Group B sample without 
rerard to their position in the matrix. It should be stated that, in 
cSison wUh Group A controls, the Group A experimental students were 
S?Jpo??ionately represented in Cell 1, the poor listener-poor reader 
category. 

Figures 11 through 19 show comparisons on pre- and post tests for 9 
studentsroneeach from matrix cells 1 through 9. Figures 11a through 19a 
lhSw?hl corresponding profiles for the same students on the lessons and 
Irt^s The profiles for the test battery are based on comparisons with 
^Ee m;an of aU studeh?s taking the pretests. The lesson profiles are 
baled on percent of items correct. Criterion was set at 80 percent. 

A striking feature of both the test battery profiles and the lesson 
orofiles is the variability within each student in regard to performance 
from dav Jo day and skill to skill. It was hoped that some pattern of 
per?oJSance SoXid emerge for students falling .athin Jhe same cell on the 
oretests but this did not prove to be the rM^e, Students with similar 
reading and listening scores initially, varied widely on their progress in 
the lessons, and in their post tests. 
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Moreover, the fact that a student was a good oral reader was no guar- 
antee of ability to perform well on the auditory tasks. This is probably 
because auditory processing of the kind taught in the program is more 
closely related to attention, set, motivation, and ability to shut out 
distraction, than to language and cognitive skills. In fa'^t, it appears 
that the lessons tap basic learning abilities whict) are not normally 
taught ^:J^p'*'^ \ *nd even though a second grade student may be above 
average . i ig accuracy end comprehension, he may be highly dis- 

tractibl" ^ . 4er problems in immediate infozmation processing which 

will ir ^ :ti his learning later on. 

The following conclusions can be drawn from an examination of the 
individual prof 'es in the subsample of 5U: 

(1) Stud< dth low initial listening ability, regardless of their 
.initial readin^ iity, made the most striking gains in both reading and 
listening. 

(2) Performance on the lessons and IRT^s was not consistent. Table 
12 in Appendix A shows^ that the pretest battery was a better predictor of 
post test performance than of performance on the IRT^s, and that correla- 
tions were low among the IRT^s for both competing messages and auditory 
discrimination tasks. 

(3) Most students made gains, some of them quite large, on the memory 
subtest of the SFTAA., This is a task which requires listening to a story 
and answering questions about it 20 minutes later, after intervening 
listening tasks. Since this skill was not taught directly in the program,^ 
the result shows an interesting transfer to an important real-I\fe listen-' 
ing task. 

(4) Many students in learning disability clinics did much better than 
might have been expected, both on the lessons and the tests. Figures lU 
and 16 show profiles of two such students. Figures lU and IMi are of a 

9 year old girl, whose initial reading level was grade level 2.1, who was 
highly distractible, and who functioned below 8 year noxms on auditory^ 
discrimination tasks. Both language and non-language achievement was low. 
After six months of the APT program, and without specific he)ry in reading 
from the LDG clinician, the student ^s oral reading accuracy was at grade 
4.1 and she had made striking gains on all but one of the auditory tests, 
in some instances as much as 2 standard deviations. 

Figures 16 and 16a are of a 10 year old boy» whose reading skills rose 
from grade 1.9 to 3.2. He did very well on the lessons and interim t2Sts, 
and his pre-post listening gains were particularly good in certain compet- 
ing message and linguistic tasks. Even more encouraging was his post test 
performance on delayed memory and retention, which rose from below average 
for 7 year olds to well above average. 

Such gains by children in learning disability groups are particularly 
important, since they have had a historj' of failure for several years. 
Indeed, far from progressing month for month in school, they fall farther 
and farther behind every year. Although the APT materials were designed 
for the age range 6.5 to 8.5, they have been found useful for children up 
to the sixlh grade. 
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The rest of the profiles in Appendix D are representative of the sub- 
sample in that they show the unevenness of performance from day to day 
that characterizes what are essentially non-cognitive tasks. Together 
-with information ga'thered from the first year, such data point to the 
'fact that auditory perceptual training is most effective when done with 
small groups, and with teacher intervention for thgse children who* have 
more than average difficulty with auditory processing. 

To the extent possible, this same subsample will be followed up in 
the third year of the project. In addition, those children who had 
losses on the post test CAPT will be followed up in a special study, to 
determine what can be done in the future to help others like them. 



3. Classroom observations and teacher feedback 

All classes were visited several times by the project director and 
technical assistant, teachers and children were interviewed, and a meeting 
was held after post test data were in to determine the reasons for the 
non-significant gains of the experimental group. Teachers were unanimous 
in declaring that the program was beneficial to their students, and all 
have asked to be in it again this coming year. In addition, the control 
group teachers have asked to be included, and the principals and advisory 
committee .members have requested much wider participation-. 

The following information was gathered which was not available to the 
external consultants when they wrote their reports: 

(1) Post testing was done concurrently with state-mandated reading 
and math testing.. While this did not disturb most of the control group 
children, who were better learners to begin with, and who felt no partic- 
ular stake in the program^ the pressure did affect a large number of stu- 
dents in the APx classes, many of whom have considerable anxiety anyway 
about their ability to perform. 

(2) Althougli 75 to 85 percent of the children can use the program 
without additional help, those with slow learning rates and high anxiety 
levels need intervention and support. This might be done with teacher 
aides or older students, if the teacher has too large a class or other 
constraints. 

(3) In general, the children enjoyed the lessons, thought they were 
fun, and identil'ied with the people who narrated the scripts. They would 
like feedback on their progress, and more flexibility in the use of the 
lessons, with provisions for working at their own pace and as their 
interests dictate. 

The project director discovered early in 1972 that the control group 
students in general scored higher on reading and listening pretests, and 
had higher verbal ability than the experimental group. At that time the 
program could have been modified to permit intervention and branching by 
teachers to assure mastery of the lessons to criterion levels. After 
discussion with the consultants, the project director decided not to do 
this, for the following reasons: (1) It was thought important to deter- 
mine precisely how much the children would benefit from use of the audio 
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tapes without teacher assistance; (2) neither time nor money was available 
for the extensive teacher inservice that would be necessary; and (3) in 
most cases, teachers in the program could not organize their classroom 
management procedures to individualize the instruction where needed. 

The decision turned out to be a poor one. The project staff tooka 
calculated risk, and lost I Repeated class observations showed that as 
many as 25 percent of the children in some "regular" second grade class- 
rooms have attention and memory problems like those of children in learn- 
ing disability clinics, and for them, small group instruction and indi- 
vidualization for th^i r neg ds are absolutely essential. 

• The program format will be altered next year to take the foregoing 
into consideration. Although the audio lessons cannot be drastically 
changed without expenditure of additional funds, they can be used in 
different ways, which will make their impact more effective. 

4. Analysis of the CAPT 

The tape-recorded Composite Auditor ■ Perceptual Test was constructed 
by the principal consultants to perform the following functious: (1) to 
test the major objectives taught in the APT lessons, and (2) to provide 
a broad spectrum diagnostic test of auditory processing which could be 
used by teachers, psychologists, or reading specialists independently of 
the APT program. It can be administered and scored by anyone without^ 
specialized training. 

The auditory abilities tested irt the CAPT were selected after a^ 
factor analysis had been performed on the individual test battery given 
to all students in the first year of the project, and after analysis of 
the results of the first year's pilot testing of the APT lessons. There 
were two major sections— Competing Messages and Auditory Discrimination— 
with three CM subsections and four AD subsections. (See Table 1 for a 
description of the test.) 

Two types of analysis were performed. The first was an item analysis 
to determine those items which differentiated between the best and poor- 
est listeners, and to determine whether the foils used in the multiple 
choice picture responses were discriminating. This was done by Robert 
Stanovich, a graduate student in educational psychology at Cal-State 
University, Hayward, and projact staff. The second was a normative 
study in grades 1 to 3, done by Harry Sturgeon, also a graduate student 
in educational psychology at Cal-State, Hayward, who used it as a basis 
for his master's thesis. 

CAPT norming report — The CAPT was administered to 367 students in 
seven school districts in Alameda County, during two weeks in March 1972. 
Students tested were first, second, and third graders in socioeconomically 
middle class residential areas. The schools participating were: Alisal 
Elementary School, Pleasanton; Bunker Elementary School, Newark; Clifton 
Elementary School, Castro Valley; Smith Elementary School, Livermore; 
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Longwood Elementary School, Hayward; Washington Elementary School, San 
Leandro; and Sunol Elementary School, Sunol* 

There were five first grade classes, six second grade classes, and 
six third grade classes tested. After observing the test given by 
Patricia Lehnen, technical assistant ^^o the project, Mr. Sturgeon handled 
all test administration. 

In addition to the classes mentioned, Mrs. Lehnen administered the 
CAPT to 35 kindergarten students at Gomes Elementary School, Fremont, 
on an experimental basis to determine the feasibility of using the 
instrument on this age group. After completing the testing, it was de- 
cided not to include these students in the norming. 

An analysis was also made by the project staff of the distribution 
of scores on the CM and AD subsections of the CAPT, for both pretests 
and post tests. Histograms of these distributions are shown in Figures 
20 through 23 in Appendix E* 

On the basis of the data from the foregoing analyses and normative 
study, the CAPT is being revised to make the instructions and examples 
more explicit, allay test anxiety, simplify the correction and scoring 
procedures, eliminate ambiguities, and provide a better range of diffi- 
culty in the tasks. One 'drawback was that the first version needed to 
be given in two sessions, to prevent fatigue. The ^revised edition can 
be administered in one session, with two short breaks. 

In summary, it was found that the auditory tasks tested have develop- 
mental implications, in that the scores rise with age. However, although 
most of the tasks should be within the competency iff "average" second 
graders, many' primary grade children have not reached these levels. Since 
these tasks of attention, short term memory, temporal sequencing, closure, 
discrimination, and receptive language are necessary for normal school 
learning, any pronounced deficits in these areas are diagnostic of problems 
which will have increasing importance as the child proceeds further in 
school. 

A word about the relationship between the auditory tasks and socio- 
economic status (SES). Although Sturgeon found a moderate correlation 
between SES and ability" to perform on the CAPT, the APT project did not. 
This discrepancy may be due to the different measures used. On the norm- 
ative study, a general designation of high, medium or low SES was made on 
the basis of data about each school and its neighborhood. (This is gener- 
ally the way SES data are generated for studies in the schools.) On the 
other hand, the Index of Social Position used in the APT project was spe- 
cific and individual for each child, based on the educational level as 
well as type of occupation of his parents. The scale will be discussed 
in more detail" in the section below. However, since the ISP is more 
exact than the general SES measure used in the normative study, it can 
probably be stated with confidence that the CAPT does not have a l,arge 
bias in favor of upper or middle class children. 
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5* Listening and reading survey 



In order to acquire data for the Index of Social Position described 
above, a survey was sent to parents of all children in both experimental 
and control groups. Two forms were used, one in English and one in 
Spanish. The survey was mailed directly to the parents, who were pro- 
vided self -addressed envelopes for its return. Returns were coded so 
that correlations could be made between the ISP and all pretest scores. 
Copies of the survey instrument are in Appendix „F. 

The Index of Social Position was used to determine the extent to 
which the educational and occupational background of the children was 
related to their ability to perform the auditory processing tasks of the^ 
program. It is different from other SES measures in that it usf^o a 
weighted scale to account for both factors, not just occupation. It 
also gives more weight to the status of an occupation than to income. 
Children's familiarity with oral language and range of language experi- 
ences is probably more highly related to these factors than to income 
alone. If the ISP had turned out to be highly correlated wich initial 
listening ability on the CAPT, the scores "would have been used as a 
covariate in the statistical analysis. This did not pr'^ve to be the 
case. 

For those wishing to use the APT tests and lessons with children 
from different backgrounds, the fact that ISP had a low correlation with 
the test is good. Responses are to easily identified pictures > rather 
than to words; the vocabulary is of kindergarten and first grade diffi- 
culty, and is taught specifically; the materials in general do not require 
prior knowledge, and minimize the cognitive aspects; and * taken together, 
they apparently have low cultural bias. 

Over 60 percent of the questionnaires were returned. The .results of 
the reading and listening survey are on the following page. Although 
no statistical correlations were made between the data and performance 
on the APT lessons, the information will be used in a follow-up study on 
a subsample of both experimental and control group children, to determine 
the part played by home background in mastery of the program. 

It is interesting to note that, although over half of the parents 
considered their children good listeners, 80 percent felt the school 
should. provide more instruction in listening. Over half thought their 
children were good readers, and 76 percent were satisfied with the way 
the school was preaching their children to read. 

Of particular interest were the Spontaneous comments made by the 
parents regarding problems they thought their children had* These 
ranged from an awareness of hearing, speech, reading, or visual per- 
ceptual problems, ^^o statements about study habits, poor concentration, 
and short attention span- The largest number of comments related to 
inability of the child to work in the face of distraction, to perform 
consistently, to tolerate frustration and worry after making mistakes, 
to work under pressure, and to have adequate self-confidence, particu- 
larly in relationship to slowness of comprehension. 
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SIBLING ORDER: 



eldest 
Youngest 
In the middle 
Only child 



32% 



70 

31%' 
.017% 



HOURS OF DAY SPENT: 



Watching T.V. 
Listening to radio 
Reading at home 
Playing outside 



2.5 hours 
21./ minutes 
41.3 minutes 
2.2 hours 



PARENTS' PERCEPTION OF CHILD: 



Good listener 
Poor listener^ 
School shot lid provide more 
instruction in listening 

Good reader 
Poor reader 

Satisfied with the way the 
school is teaching your 
eh'* Id to read: 



53% 
43% 



54% 
43% 

76% 

10/ 



Yes 
No 



Yes 
No 



PARENTS' PERCEPTION OF THE WAY THEIR CHILD LEARNS BEST: 

Showing him 81% 
Telling him 32% 
Having him read something 26% ^ 
Rewarding him 19% 
Letting him find out for 

himself 20% 
Having him look at pictures .2_5% 
Having him work along with 

you- 

Other: Letting him work alone; just answering ques- 
jtions; by example; repetition and memorizing; 
(teacher; special extra reading; homework or 
drills; practice on own after being shown or 
told; mother and sister help; praise and 
encouragement; written example; patient 
explanations. - ^ 

SPECIAL PROBLEMS IN LEARNING: 28% Yes 



Although parents were told that they need not sign their names, 
several did so — one even sent in the questionnaire afte^ moving to the * 
middle west. Because of the confidential nature of the survey, the com-- 
ments were not passed on to the teachers. However, the overall results 
will be used in the third year for discussion in the inservice training, 
and an effort will be made. to involve parents in the APT program itself. 

6. Data from additional project sites 

Two additional field test sites outside of Alameda County were set 
up during March-May, IS'^, at the request of people who had heard about 
the project. No costs wiere incurred by Title III. One was in the 
Bilingual Diagnostic Placement Program in Santa Ana, California. In- 
structors were Judy Montgomery, speech therapist, and Herb Michel, per- 
ception teacher. Both instructors observed the project in the four LDG 
clinics in Fremont. Their report is found in Appendix G. 

The purpose of trying out the program there was to determine the 
feasibility of futuj:e use with EMR childi?en and those with a Spanish- 
language background. The tapes and listening books were duplicated in 
Santa Ana. The booklets were laminated, so that children could erase 
their marks and do the lessons over to achieve criterion level. While 
this was novel and highly motivating at first,^ the instructors eventu- 
ally decided that erasures were too easy, and that the lamination 
feature took attention away from the task. 

Children took the lessons in very small groups. In general, after 
the first set, the lessons became too difficult for the children. If 
Santa Ana uses the program next year, it will be with 9 to 12 year old 
non-readers, who can do the marking tasks, but who need the skill 
development. 

The other test site was at the Campus School of Eastern Washington 
S.tate College, Cheney, Washington* Dr. Jackson Martin, director, and 
three primary grade teachers participated. At this writing, their evalu- 
ation report is not yet in. A telephone conference in May^, however, 
indicated that teachers and children were highly pleased with the lessons 
which were taken by the children individually in listening centers on a 
self -demand basis. Information from their experience with the first set 
of lessons is being used to modify the program in Alameda County next 
year. 

Conclusions 

Evaluation activities by project staff proved highly useful for 
making decisions for the third year. Analyses of class and individual 
progress were used to provide bases for revision of materials and pro- 
cedures for content of teacher inservice. Classroom observations 
proved useful as checks on the reasons for student progress or lack of 
it. The listening and reading surv(5y showed the nature of parental 
interest and suggested possibilities for parent involvement next year. 
Finally, extensive data on the CAPT made it possible to improve the 
validity and reliability of the instrument, contributing to its 
general usefulness as a diagnostic tool beyond the confines of the 
APT program. 
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PROJECT PHASES AND PER PUPIL COSTS 



1. 367 Number of pupils directly served by the project. 

2. $75,203 Developmental costs. 

3. $ 205 Developmental costs per pupil. 

^. $ 8,27^ Implementation costs. 

5. $ 23 Implementation costs per pupil. 

6', $ 3.931 Operational costs. 

7. $ 10 Operational costs per pupil. 



The above figures represent expenditures incurred by the 
project, but they do not reflect actual implementation and 
operational costs that would need to be borne by districts after 
adoption. Implementation includes teacher inservice, which would 
have no costs for those districts having trained resource teams 
by June 1973. It also includes purchase of one set of audio 
tapes and a Teacher Manual for each class in the program, an 
expenditure of about $50 per class. 

Operational costs will consist only of purchase and 
replacement of the listening booklets which accompany the audio 
tapes. These are consumable, and with mass production, it is 
estimated that the cost would be $^:00-$5:00 per pupil or less. 
The lessons constitute a yearns program. The diagnostic pretest 
will probably cost $ .50 per pupil. 
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Fotw FO 379 
(Revised 7-70) 



CALIFORNIA STATE DEPARTMEHT OF EDUCATION 
Bureau of Program Planning and Oevelopmcnt, Title III, ESKA 
Supplonentary Centers and Services Program 
(Title III, BSEA, PL 89-10) 



CLAIM FOR REIMBURSEMENT 



Project Number 


Budget Period (Mo«» Dey» Year) 
Beginning; July 1, 1971 


Date of Notification of 
Grant Award 


X Project Continuing 


0471 


Ending: June 30, 1972 


June 10, 1971 


Project Terminated 



.ROTE: A, separate claim must be made for funds awarded from different fiscal years. 

Therefore, a separate claim must be made for each grant award. (See Instructions 
on the back of this sheet.) 



Expenditures ' 
Cash advance received 
Relmbtirscment now claimed 
* . OR . 

Excess cash received 
(See Instructions for handling excess) 



87,471 



78.724 



$ 



8,747 



CERTIFICATION 



I CERIirx^ that cht expendicures reported above have been made, and thac. all obligations nave 
been liquidated; that this project has been conducted In accordance with applicable laws and 
regulations; that the approved application for this project plus any approved amendments are 
available for audit. 



Alameda County Schools 




AutluTlsed Agent 



Legal name of district or organisation 



j^sslstant Supt. , Business Services 
Title 



224 West Winton Avenue 



Street Address 



September 6, 1972 



Hayward 



CA 



Date Signed 



City 



SUte 
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94544 



ZIP Code 



FOR STATE USE ONLY 
PROJECT COMPLEHON 
AND CUIM APPROVED 

By 



Bureau of Program 
Planning and 

Development 



APPENDIX A 

Tables of Data Analyses 



Table L 



DESCRIPTION OF TESTS 

Teacher Rating Scale ; a 6-point Likert scale for assessment of 
student listenin'g ability, 

Gilmore Oral Reading Test 
An individually-administered, standardized --test of oral reading 
proficiency with three subtests: 

Gilmore Accuracy Subtest ; a test of oral reading accuracy based 
upon avoidance of 8 types of errors. 

Gilmore Comprehension Subtest : a test of oral reading comprehension 
based on correct responses to a combination of recall and 
inferential items. 

Gilmore Rate Subtest : a test of oral reading rate measured in words 
per minute. 

Composite ; ^yj itorv Perceptual Test CCAPT) 
A taped, group-admini"''^"^red, project -developed test of auditory 
perception with tw major subsections; 

Competing Messages fCM) Subtests 
Recorded message in which two voices speak simultaneously at varying 
signal-to-distraction ratios with four subtests; 

CM I : a 10-item subtest using a male leader and female distractor 
with varying s/d ratios for recognition of spondee words. 

CM II : a 15-item subtest using a female leader and male distractor 
with more variable S/D ratios for recognition of single syllable 
words chosen for their phonemic characteristics. 

CM III ; a 15-it :n subtest using a female leader and female dis- 
tractor for recognition of single syllable words. 

CM IV : a 15-item subtest using randomly alternating, male and female 
leaders with a 0 decibe"" S/D ratio throughout for recognition of 
single syllable words. 

Auditory Discrimination (API But jests 
Recorded instructions required students to respond to various 
phonetic and linguistic tasks with three subtests; 

AD I ; a 36 -item subtest requiring analysis of speech sound placement^ 
and consonant and vowel discrimniation. 



10. AD II ; a SS-item subtest measuring the sk^l^s ^ f ditory closure, 

synthesis, and syllabication of real ano f on .»€r jrds, 

11. AD III ; a 22.item subtest dealing with language ass^w^iation concept 

categories and grammatical categories such as active-passive, 
negative, and verb tease • ^ 

Short-Form Test of Academic Achievement fSFTAA) 
A standardized, group-administered test of verbal and non-verbal 
aptitudes; four subtests: - 

12, V ocabulary Subtest : a 25-item subtest measuring verbal comprcehension 

and knowledge of word meanings- 

13, Analogies Subtest ; a 20-item non-verbal subtest measuring the recog- 

nition of literal and symbolic relationships, 

lU. Sequences Subtest ; a 20-item non-verbal subtest using dots, numerals, 
and letters requiring the recognition of patterns » rules, and 
principles, 

15. . Memory Subtest ; a 20-item verbal subtest involving delayed retention 

of story details and general comprehension- 

16, Lindamood Auditory Conceptualization Test : a 28-item individually 

administered test designed to measure conceptualization of speech 
patterns, specifically temporal sequencing- 
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Table 2 

DESCRIPTION OF TARGET POPUIATION 



B 



Boys 
Girls 

Totals 

Ethnic Groups ; 

1. Spanish surname. 

2. Other white 

3. Black 

ij. Oriental 

5. American Indian 

6. Other non-white 

Language of the Child ; 

1. Standard English 

2. Black English 

3. Foreign Dialect 

Language of the Parents ; 



1* 
2. 



English 
Other 



Social Class ; 

I 11-17 
II 18-27 
III 28-1 - 
IV ^«t-60 
V 61-77 



Ifean; 



X 


C 


X 


C 


85 


70 


25 


30 


.11 


69 


in 


7 


152 


139 


39 


37 


18 


19 


9 


6 


108 


92 


28 


31 


22 


26 


1 


0 


1 


1 


1 


0 


3 


I 


0 


0 


0 


0 


0 


0 


130 


135 


36 


37 


20 


3 


1 


0 


2 


1 


2 


0 


11^7 


130 


36 


37 


5 


9 


3 


0 




3 




2 


8 


13 


5 


6 


i|0 


31 


8 


6 


70 


69 


18 


13 


30 


23 




10 


1^8.1^6 


1^7.55. 


^2.6.8 


^7.08 



Chronological Ages in Months fO ctober 1. 19711 



Group A: 
81-83 
8>^-90 
91-96 
97-111 



Mean: 



18 
71 

in 

21 
90.53 



21 
67 
30 
20 
90.12 



Group . B: 
83-96 
97-108 
109-120 
121-132 
133-W5 



Mean : 



5 
10 
9 
8 
6 

m.i^5 



5 

9 
12 
7 

118.35 



erJc 
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Table 3 



DIFFERENCES BETWEEN EXPERIMENTAL AND CONTROL GROUPS ON PRETEST MEANS 

Group A Group B 



X 


C 




X 


C 




means 


• 

t-test 


means 


t-test 


3.19 


3.06 


.75 


1.90 


2.02 


.56 


16.93 


17.36 


.35 


16.35 


20.17 


i.iw 


2.06 


2.11 


.35 

- 


1.99 


2.37 


1.22 

• 


1.68 


1.7^ 


.33 


1.90 


2.15 


.67 


.13 


.12 


.12. 


.30 


.15 


1.28 


2.28 


1.86 


2.10* 


1.02 


.82 


.7»f 


.1^ 


.16 


.30 


.32 


.22 


.85 


.09 


.09 


.13 


.10 


.13 


.35 


.12 


^8 


1.53 


.10 


,15 


.60 


.69 


.78 


1.07 


.77 


1.15 


1.19 


.08 


.l«f 


.96 


.22 


.10 


1.52 


16.65 


16.95 


.29 


16.67 


19.77 


1.27 


2.27 


2.38 


.66 


2.38 


2.86 


1.12 


52.21 


57.2»t 


1.37 


51.75 


69.05 


2.06* 



1. TEACHER RATING SCALE 

2. GILMORE ORAL READING TESt: 

a. Accuracy (Raw Score) 

b. Accuracy ^Grade Equivalent) 

Type of reading errors, 
average number per paragraph: 
Substitutions 
Mispronunciations 
Words pronounced by examiner 
Punctuations 
Inssrtions 
. Hesitations 
Repetition ; 
Omissions 

Comprehension (Raw Score) 
Comprehension (Grade Equivalent) 
e. Rate (Words per Minute) 

3 * CAPT - Competing Messages (CM) : 

Part I ^.99 6.26 5.2^** 5.05 6.85 3.56** 

Part II 8.88 9.26 I.I9 8.10 9.20 1.66 

Part III 7.78 O.^H 1.87 7.30 7.75 .52 

Part IV 12.13 12.68 2.22* 11.70 12.63 1.66 

CM Subtotal 33.79 36.53 3.13** 32.15 36A2 2.12* 

M^. CAPT - Auditory Discrimination j(AD): 

Part J W.93 52.08 2.27* 53^80 55.38 .95 

Part II' 38.98 39.05 .07 39.77 39.88 .05 

Fart III 13.70 lif.85 1.78 12.5*3 U.02 .75 

AD Subtotal 102.5if 105.91 1.75 106.50 109.28 .68 

CAPT TOTAL 136.3^ 1^2AS 2.S5* 138.65 145.70 1.33 

5. SHORT FORM TEST OF ACADEMIC ACHIEVDiOiT': 
Part !• Vocabulary 
Part 2^ Analogies 
Part 3. Sequencing 
Part M^* Memory 
SFTAA Language (1 + 4) 
SFTAA Non-Language (2+3) 

SFTAA TOTAL 



15.2»t 


15.22 


.03 


17.90 


19.75 


2.13* 


10.83 


11.15 


.68 


11.80 


12.65 


.97 


11.88 


12.1*9 


1.20 


12.82 


1^.35 




11.02 


11.39 


.82 


10.75 


13.13 


2.W* 


26.26 


26.61 


.1*7 


28.65 


32.88 


2.53* 


22.71 


23.6»t 


1.12 


2»f.63 


27.00 


l.»H 


W.97 


50.25 


.95 


53.28 


59.88 


2.21* 



*8ignificantiat .05 level 
**significgnt at .01 level 
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Table ^ 



PRE-POST (X)MPARISONS 



Experimental Group A 



Test 

TEACHER RATING SCALL 

GILMORE ORAL READING: ' 

Accuracy . ) 

J Grade 

Comprehension) Equivalents 
Rate - Words Per Minute 
CAPT: (Competing Messages) 
CM I 
CM II 
CM III 
CM IV 

CM Subtest Total 



Pretest 



Post Test 



Mean 
3.20 

2.10 
2.39 
54.25 

5.12 
9.07 
7.95 
12.27 
34.09 



CAPT: (Auditory Discrimination) 

AD I 50.12 

AD II 39.37 

AD III 13.83 

AD Subtest Total 103.62 

CAPT TOTAL 137.57 

SFTAA IV - MEMORY 11.34 

CAPT CM MARKING ERRORS .84 

CAPT AD MARKING ERRORS 3.24 



Standard 
Deviation 

1.43 



1.08 
1.42 
27.59 

2.20 
4.05 
2.98 
2.94 
8.09 

10. 3o; 

7.71 
5.79 
17.70 
22.45 
3.96 
3.38 
"4.63 



Meaji 
4.12 

3.35 
3.89 
73.81 

6.96 
9.69 . 
7.67 
11.67 
36.01 

57.21 
43.51 
15.02 
115.91 
151.92 
13.02 
1.16 
5.70 



Standard 
Deviation 

1.35 



1.11 
1.68 
23.09 

1.93 
2.89 
3.26 
2.58 
8.21 

7.09 
8.26 
5.53 
16.13 
20.71 
4.03 
2.48 
6.13 



Correlated 
t -ratio 

8.20* 



16.57* 
11.89* 
10.98* 

8.83* 
1.58 

- .85 

- 2.11* 
2.92* 

8.42* 
5.99* 
2.15* 
9.39* 
9.30* 
5.30* 
5.59* 
4.35* 



♦Significant at .05 level 
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Table 5 



r 

Test 

TEACHER BATING SCALE 
GILMORE.ORAL READING: 

Accuracy ) Grade 
Comprehension) Equivalents 

Rate - Words Per Minute 
CAPT: (Competing Messages) 
CM I 
CM II 
CM III 
CM IV . 
CM Subtest Total 



PRE-POST COMPARISONS 
Experimental Group B 
Pretest 



Post Test 



Mean' 
1.91 

2.24 
2.65 
55.00 

5.12 
8.18 
7. 43 
11.85 
32.58 



CAPT: (Auditory Discrimination) 

AD I 53.52 

AD II 39^.76 

AD III 13.18 

AD Subtest Total 106.45 

•CAPT TOTAL • 139.03 

SFTAA IV- MEMORY 10.39 

CAPT CM MARKING ERRORS 1.48 

CAPT AD MARKIhiG ERRORS 3.55 

♦Significant at .05 level 



Standard 
Deviation 

1.01 



1.43 
1.68 
32.91 

.2.37 
2.66 
3.25 
1.99 
8.17 

8.07 

9;45 

6.55 
18.31 
23.78 
3.51 
4.13 
5.73 



Mean 
1.91 

3.09 
3.64 
.65.67 

7.43 
10.12 

8.64 
II773 
37.91 

56.79 
44.67 
16.79 
118.24 
156.15 
.13.42 
. 1.48 
5.76 



Standard 
Deviation 

1.01 



1.10 
1.87 
19.90 

1.77 
2.94 
3.90 
3.02 
8.69 

10.60 
8.76 
5.60 

20.75 

27.51 
3.63 

. 2.85 
7.07 



Correlated 
t-ratio 



5.34* 
2.86* 
2.25* 

4.99* 
3.25* 
1.89 
- .26 
3.95* 

.25 
3.37* 
2.64* 
4.51* 
5.78* 
6.88* 
0 

1.68 
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Table 8 

CAPT TEST-RETEST COEFFICIENTS 
OF RELIABILITY 



Auditory Discrimination Competing Messages 



AD 


I 


.42 


CM 


I 


.39 


AD 


II 


.54 


CM 


II 


.42 


AD 


III 


.41 


CM 


III 


.22 


AD 


subtest 


.65 


CM 


IV 


.33 








CM 


subtest 


.52 



CAPT Total .66 



Note: These coefficients were based upon control group data 

for Group k. The' time interval between testing was approximately 

7 months. 
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.Table 9 

PRETEST DIFFERENCES DUE TO ORDERING 
OF AD AND CM SUBTEST TEST ADMINISTRATION ON THE CAPT 

FOR GROUP A ONLY 

CM First , AD First t-test 

• 

CAPT - CM I 5.52 5.70 .72 

CAPT - CM II 8.62 9.50 2.82** 

CAPT - CM III 7.1^6 8.68 ■ 3.73** 

CAPT - CM IV 12. 12.39 .09 

CM Subtotal 33. 9^ 36.27 | 2.66** 

CAPT - AD I 51.60 50.38 1.27 

CAPT - AD II 39.6k 38.1H 1.38 

CAPT - AD III IkAk^ 1^.09 , .53 

AD Subtotal 105.60 102.82 l.iW 

CAPT TOTAL 139. 5^ 139.09 .19 



♦♦significant at .05 level 
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Table 12 



CORRELATION MATRICES FOR PRE-POST (APT 
AND INTERIM REVIEW TESTS 



CAPT 
AD' Subtests 







PRE 


IRT 1 


IRT 2 


IRT 3 


IRT U 


PRE 




31* — ^ 




.Ul 


.«♦«♦ 


IRT 


1 






.2'! 


.30 


.2H 


IRT 


2 








-.19 


.37 


IRT 


3 










.15 



IRT U 
POST 



CAPT 
CM Subtests 







PRE 


IRT 1 


IRT 2 


IRT 3 


IRT U 


PRE 






.43 


-.07 


.35 


.2H 


IRT 


1 






-.19 


.34 


.13 


IRT 


2 








-.36 


-.18 


IRT 


3 










.02 



IR1V,U 
POST 



CAPT Total 







PRE 


IRT ]. 


IRT 2 


IRT 3 


IRT U 


PRE 






.20 


.33 


.37. 


.40 


IRT 


1 






-.52 


-.34 


-.3U 


IRT 


2 








.10 


.33 


IRT 


3 










.57 


IRT 















POST 
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Table 13 



'rotated factor matrix (3 FACTORS) 





Variables 


Factor I 


Factor II 


Factor III 


1. 


Teacher Rating Scale 


.62080 


-0.10850 


.25635' 


2. 


Gilmore Accuracy 


.91093 


.08U25 


.10462 


3. 


Gilmore Comprehension 


.87089 


.11653 


.14380 


U. 


Gilmore Rate 


.91910 


.07679 


.07488 


s. 


CM I 


.01855 


.73609 


.18649 


6. 


Ch* .1 


-0.0DS07 


.83106 


.07909 


7 




.0851M 


.71457 


.17626 ^ 


8. 


CM IV 


.08902 


.69469 


.12045 


9. 


AD I 


.23601 


.22973 


.63237 


10. 


AD II 


.47573 


.23354 


.44549 


11. 


AD III 


.19892 


.27£81 


.44415 


12. 


srrAA I 


.10781 


.12886 


.71226 


13. 


SFTAA II 


.08U38 


.00583 


.68242 


w. 


SFTAA III 


.20613 


.09124 


.65841 


15. 


SFTAA IV 


-0.02608 


.17^66 


.70159 



-96- 



Table 

ROTATED FACTOR MATRIX FACTORS) 



3> 





Variables 


Factor I 


Factor II 


Factor III 


Factor IV 


1. 


Teacher Rating Scale 


.59601* 


-0.08285 


.02282 


.38851* 


2. 


Gilmore Accuracy 


.91393 . 


.0721*3 


.11691 


.05228 


3. 


Gilmore Comprehension 


.87681 


.1003'* 


.17880 


.038^9 


^. 


Gilmore Rate 


.91959 


•Ub9Ub 


.UOD/M- 




c ■ 

->•, 


nui T 
CM 1 . 


m QQ^ 








6. 


CM II 


-0.00130 


.82791 


.10632 


-0.01676 


7. 


CM III 


.08309 


.72057 


.1231*2 


.11739 


8. 


CM IV 


.08719 


.70123 


.07327 


.09060 


9. 


AD I 


.29876 


.21387 


.61169 


.2637«* 


10. 


AD II 


.1*51*19 . 


.25527 


.21898 


.1*3991 


11. 


AD III 


.191*27 


.27539 


.36756 


.25526 


12. 


SFTAA. I 


.12220 


.091*92 


.791*68 


.16891* 


13. 


SFTAA II 


.031*05 


.06525 


.19803 


.81910 




■SFTAA III - 


. .16823 


.13309 


.28172 


.68729 


15. 


SFTAA IV 


-0.00932 


.13582 


.801*96 


.13557 
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Table 15 







ROTATED FACTOR MATRIX f5 FACTORS^ 








Variables 


Factor I 


Factor II 


Factor III 


Factor IV 


Factor V 


1. 


Teacher Tating 
Scale 


.59857 


-0.07626 


.02862 


.39402 


-0.03635 


2 


fli 1 mOT*P 

Accuracy 


.91389 


.06301 


.09957 


.04602 


.07707 


3. 


Gilmore 
uomprene ns xo n 










nQ7UR 


^ ft 


Gilmbre Rate 


,919U5 


t t T 

.06061 


.05130 




.UDcD/ 


5. 


CM I 


.026U6 


.74920 


.16881 


.09357 


.00583 


6. 


CM II 


.00098 


.81952 


.08587 


-0.02232 


.13251 


7. 


CM III 


.07926 


.68145 


.06197 


.08919 


.33850 


8. 


CM IV 


.09588 


.72668 


.09878 


" .11007 


-6.10487 


9. 


AD I 


.30925 


.23884 


.63284 


.28223 


-0.04350 


10. 


AD 11 


.45619 


.24640 


.19849 


.43404 


.12805 


11. 


AD III 


.17594 


.16347 


.20934 


.17290 


.83882 


12. 


SFTAA "l 


.13064 


.10827 


.80006 


.17839 


.05370 


13. 


SFTAA II 


.03319 


.04370 


.16190 


.80364 


.21970 


in. 


SFTAA III 


.17586 


.15094 


.29665 


.70093 


-0.03377 


15. 


SFTAA IV 


-0.00624 


.12225 


.77447 


.12506 


.23886 
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Table 16 

MEAN PERCENT OF ITEMS CORRECT ON INTERIM REVIEW TESTS 



FOR GROUPS A AND B 



Interim Review Test Group A Mean Group B Mean 

Set 1 81 83 

Set 2 80 . 80 

. Set 3 81 . 86 

Set »t 70 75 



Table 17 

MEAN PERCENT OF ITEMS CORRECT ON SET 1, 
BY GROUP A SCHOOLS 



School 
Code 


1.1 


1.2 


1.-3 


Lesson Number 
1.4 1.5 1.6 


1.7 


1.8 


1.9 


IRT 
CM AD 


Total 


AXOl 


87 


67 


77 


92 


83 


90 


90 


63 


57 


75 


65 


76 


AX03 


92 


77 


66 


94 


82 


93 


60 


93 


72 


78 


72 


83 


AXpS 


98 


83 


85 


99 


86 


95 


92 


55 


73 


91 


76 " 


85 


AX07 


76 


43 


20 


81 


59 


69 


67 


22 


23 


55 


59 


69 


AX09 


96 


84 


75 


98 


77 


90 


94 


41 


55 


91 


77 


87 


AXll 


90 


71 


72 


96 


83 


86 


90 


46 


54 


88 


74 


83 



Table 18 



PERCENTAGE REACHING CRITERION f809fl ON SET 1 , 
BY GBOUP A SCHOOLS 



School 
Code 

AXOl 


1.1 


1.2 


1.3 


Lesson Number 
1.4. 1.5 1.6 


1.7 


1.8 


1.9 


IRT 
CM AD 


Total 


92 


40, 


56 


90 


72 


75 


91 


33 


20 


52 


28 


32 


AX03 


98 


48 


52 


96 


72 


98 


88 


33 


44 


63 


27 


73 


AX05 


96 


56 


77 


100 


76 


100 


98 


23 


40 


97 


43 


83 


AX07 


56 


0 


18 


65 


34 


27 


30 


0 


0 


26 


6 


12 


AX09 


98 


63 


72 


100 


50 


92 


100 


8 


28 


92 


48 


81 


AXll 


84 


50 


63 


100 


73 


83 


91 


7 


11 


84 


21 


64 
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APPENDIX B 

Studeat Behavioral Objectives 
for APT lessons 



STUDENT BEHAVIORAL OBJECTIVES FOR APT LESSONS 



l.a By the end of Set 1.0, the- child will be able to do the following 
tasks: 

1.1 Given tape-recorded presentations of six noisemakers, pre- 
sented twd, three, or four at a time in varying sequences, 
the child will choose the correct order of presentation by 
making an X on the appropriate box in his Listening Book. 
The sounds will be presented within sequences without pauses, 
and four seconds will be allowed between sequences for 
response. 

1.2 Given minimal pairs of one-syllable words containing con*» 
trasts of the vowels short i^y short £, and short the 
child will identify the correct vowels by making an X in the 
appropriate box in his Listening Book. 

1.3 Given a series of tape-recorded instructions, which include 
* words with the phonemes /s/, /z/, /k/, /r/, and /ee/, in 

initial, medial, and final positions, the child will correctly 
identify the word containing the designated sound by drawing 
a circle -around the appropriate picture in his Listening Book. 

Choices will be made under the following conditions of pres- 
entation: 

1.3.1 When the sound is presented in isolation. 

1.3.2 When the sound is presented in nonsense words of one 
or two syllables. 

1.3.3 When the sound is presented in real words of, two 
syllables. 

1.3.^ When the sound is presented in one or more words 
within a sentence. ^ 

1.3.5 When the sound is presented in a context in which it 
could be mistaken for a siQiilar sound. 

2.0 By the end of Set 2.0, the child will be able to do the following 
tasks: 

2.1 Given a series of tape-recorded directions spoken by five 

different speakers — 2 men, 2 women, and 1 child — with distinct 
vocal characteristics, the child will make an appropriate^ 
response to the designated speaker. Directions will be given 
by either three or four speakers speaking successively. 
Responses will consist of choosing the correct picture from 
rows of 5 pictures by making a specified mark. 



b 
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2.2 Given the tape-recorded presentation of words of one to 
four syllables, in which certain sounds have been systemat- 
ically omitted, the child will identify the word by drawing 
a circle around the correct picture in his Listening Book, 
when the set of pictures from which he may choose includes 
words with similar sounds • The sounds will be systematically 
omitted from initial, middle, and final positions in the - 
words. 

2.3 Given the tape-recorded presentation^ of one to four syllable 
words in which the sounds. of the wc^^ds are spoken individu- 
ally at intervals of^ one to three seconds,, the child will 
correctly identify the word by drawing a circle around the 
appropriate picture. 

2.^ Given a sentence with a complex intonational pattern, the 
child will identify the correct pattern by making an X on a 
picture representing the intonation curve, from a choice of 
two pictures. 

2 5 Given a series of speech sounds presented in isolation, from 
two to five at a time, the child will identify the correct 
order of presentation by making an X on the appropriate box 
in his Listening Book. 

By the end of Set 3.0, the child will be able to do the following 
tasks: 

3.1 Given tape-recorded utterances of nonsense syllables, words, 
phrases, and sentences, the child will correctly identify: 

^ 3.1.1 The number of sounds in one-syllable words. 

3.1.2 The number of syllables in words of two to six 
syllables. - 

3.1.3 ^ The number of syllables in a phrase* 

3.1.1* The number of syllables in a sentence. 

The responses will be made by circling the correct number 
from a series of numbers presented in rows in his Listening 
Book* or making an X in the appropriate box. 

3 2 Given two speakers uttering similar directions simultaneousl; 
the child will respond to the designated speaker by making 
the designated mark on one picture in a row of five. The 
difficulty of the distraction will be varied in three ways: 
(1) similarity of voices, (2) similarity of directions, and 
(3) similarity of loudness. 

By the end of the set, the child will respond correctly to 
the designated speaker ♦s voice when the distracting voice is 
softer or of equal loudness. 
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By the end of Set M.Q^ the child will be able to do the follow- 
ing tasks: 



U.l Given two speakers speaking simultaneously, the child will 

respond correctly to the directions of the designated speaker 
when the distracting speaker is giv'ng similar directions 
under the following, conditions:' 

H.1.1 When the distracting voice is of equal or greater 
loudness than the designated voice. 

^•1.2 When the designated speaker is switched frequently 
within the lesson. 

H.1.3 When the voices are similar in quality, e.g., two men, 
two women. 

H.2 Given the taped presentation of a series of language tasks, 
the child will be able to identify and discriminate between 
a specific number of syntactical categories (singular- 
plurcl nouns, verb tenses and voices, and prepositions) and 
select appropriate grammatical (conceptual) categories. 
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APPENDIX C 



Class and Composite Profiles' 
of Progress for Groups A and B 
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Figure 2. 

Coinposite Class Profiles 
APT Lessons and Interim Review Tests (IRT) 
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Figure 3 

Composite Class Profiles 
APT Lessons and Interim Review Tests (IRT) 



Group B 



O » CM (Competing Message) strand 

O « AD (Auditory Discrimination) strand 

Qm IRT Total 



Set I 



Set II 



100 




4J 
W 

(H 50 
o 

u 

c 30 

CO 

20 



10 - 



M I t I M M I I I 



• ••••••• •rn rn rn 

HHH.HHHHH H^^^ 



•3 




CM 



• •••••••H 

CMCMCMCMMMMOJ^t 

CM 



H CM CM CM 
H H H f-1 
t • t • 

CM CM CM, CM 

H 



-105- 



Figure U 

Composite Claet Profiles 
AFT Lessons and Interim Review Tests (IRT) 
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Figure 5 



Separate Class Prpfiles 
APT Lessons and Interim Review Tests (IRT) 



Group A 



O * CM (Competing Hessage) strand 

□ * AD (Auditory Discrimination) strand 

O* ZRT Total 



SET I 



CLASS AXOl- 



CLASS AX03 




<M 50 
o 

c 30 
« 

20 

.10 
0 



100 ..^ 



I I I I I I I I 1 M I 



• ••••••• •HHH 

H H H 




«w 50 H 
o 

g uo 

c 30 
m 



20 

10 
0 



I I I I I I I I I I I I 



•••••••••HHH 



5 



.ERIC, 



-107- 



Figure 6 

Separate Class Profiles 
APT Lessons and Iitteriai Revleti Tests (IRT) 
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Figure 7 



Separate Class Profiles 
APT Lessons and Interim Review Tests (IRT) 
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Figure 9 

Separate Class Profiles 
APT Lessons and Interim Review Tests (IRT) 
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APPENDIX D 

Selected Individual Student 
Profiles from Subsample 
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Figure 12a 
Individual Student Profile 
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STUDENT PROFILE - DIAGNOSTIC TEST BATTERY 
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Figure 15a 
Individual Student Profile 
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Figure 16 

STUDENT PROFILE - DIAGNOSTIC TEST BATTERY 
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Figure 16a 
Individual Student Profile 
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Figure 18 
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Figure 19a 
Individual Student Profile 
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APPENDIX E 



Histograms of Distribution of Soores 
on Pretest and Post Test CAPT for 
Groups A and B 
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. APPENDIX F 




Reading and Listening Survey 



\ 




HEADING 



IMPROVEMENT 



THROUGH 



AUDITORY PERCEPTUAL TRAINING 



BELLE RUTH WITKIN, 

DIRECTOR 

224 WEST HMNTON AVENUE 
HAVWARD» CAC*rORN>A •4M4 
ROOM ITS 

(419) TtMtOO EXT. 372 



January 2i^, 1972 



Dear Parent: 



Your child. 



is participating this 



year in a special program to help pupils in elementary schools 
learn to listen and read better. Several hundred children are 
trying new kinds oi materials, which have been developed espe- 
cially for schools in Alameda County under a federally funded 
project. To help us plan lessons that relate to the experiences 
and background of all children in the program, we need to know 
more about them and tlieir families. We would appreciate your 
answers to tiie questions on the enclosed survey. , 

Neither your name nor your child's is required and will not be 
used in this study, since we are only concerned with group 
performance. Please complete the questions and return the 
survey, in the enclosed stamped self -addressed envelope by 
February 1* Do not sign your name. 

Thank you yrery much for your cooperation. 



Sincerely, 




Belle Ruth Witkin, Di^^ctor 



BRWret 
Encs. 



ERLC 
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.^AN ESEA rniB III PROJECT (PL. 90-247) • OPERATEO BY THE^ALAMEOA COUNTY SCHOOL OEPARTMENT»..R0CK LAFLECHE, SUPERINTENDENT 



UtAOINO IM^fltOVCMKMT TNHOUaN 

AUDITORY PERCEPTUAL TRAINING 



LISTENIMG AND READING SURVEY 



THINGS WE NEED TO KNOW ABOUT YOUR CHILD 

1. Is he/she the oldest? £7 youngest? 77 ^ middle? /7 

2. About how many hours does your child spend each day in the following? 

watching T.V. 

listening to radio 

reading at home 
" " playing outside 

Yes No 

3. Do you think your child is a good listener? • • • 

Do you think the school should provide more ^ 

instruction in listening? £/ 

5. Do you think your child is a gbod reader? /_/ /V 

6. Are you satisfied with the way «ie school is _ _ 
teaching your child to read? /_/ /y 

7. As a parent, how do you tMrik your diild learns best? (check one or more) 
showing him 77 letting him find out for himself /V 
telling him /7 having him look at pictures ^7 
having him read something /~ having him %#oik along witti you /_/ 
rewarding him /7 other (specify) 

- ^ t i Yes No 

8. Does your child have any special problems in learning — 

that the schools should know^about? /-y fj 

9. If yes , what are tiiey? , ^ 



THINGS WE NEED TO KNOW ABOUT YOUR FAMILY 

1. Please chedc the family members living at home: 

father /7 brothers £J how many? sisters fj how many?_ 

mother /7 others (specify)^ ^ 



2. Who is the head of the household? (Check one) 

favher /7 mother /7 guardian /V other (specif y)__ 

3. What kind of work does the head of tiie household do? (Be as clear as you 
can about the work.l 

~ ^s ^ 
Is the head of the household employed now? /-y 

5. Is the head of the household self-employed? • • n £7 

6. How far did the head of the household* go in school? (Check one) 
less than 7th grade /T grades 7, 8, or 9 /T grades 10 or 11 fj 
high school or trade school graduation /7 some college /_/ 
^«year college degree f? graduate professional training /7 
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IICAOINO IMmOVCMCHT THflOUGN |S3B9 

AUDITORY PERCEPTUAL TRAININC. ngSI 
22^ West Winton Avenue, Hayward, California 9U5H»/' 



Etiero 24, 1972 
Estimados padres: 

Su hijo(a)_ participando este a!b 

ea un programa especial para ayudar a los alumnos de las escuelas 
elementales a leer y escuchar major. Varios clentps de alumnos est& 
usando materiales educativos nuevps, los que ha side diseSados en 
nuestro condado usando fondo^ del goblercio federal* Para ayudarnos 
a planear lecciones que »e relacjLonen mas a las experiencias de todos 
los nlfios en el programa^ necesitanos saber mis acerca de ellos y de 
las familias de donde proceden. Lo apreQlariamos muchlsiioo si Ud. 
pudiera contestar las preguntas que se encuentran en el formulario 
que adjuiitamos. 

No se require que Ud. ponga su nombre o el nombre de su hijo(a) porque 
estamos m&s interesados 'in lo que el grupo total de nlSos puede hacer. 
Favor de completar las preguntas y devolver el formulario usando el 
•obre que se ad junta y antes del lo. de Febrero. Recufirdese de que no 
es necesario poner su nombre en el formulario o en el sobre. Muchlslmas 
gracias por su cooperaci6n y ayuda. 




Belle Ruth V/itkin, Director 
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INVESTIGACIOH SOBRE "LEER Y ESCUCHAR" 



IMPORMACION QUE NECESITAMOS ACERCA DE SU HI JO (A): 

1. lEs 61/ella (la) mayor de todos los hljos? ©8 61 (la) menor?^ 

ea 61 (la) del medio? 

2. Mas o menos^ cuantas horas pasa su hi jo (a) por dla: 

mirando la televisl6n ; leyerido en casa 

escuchando la radio jugando fuera de la casa 

3. ^Pieivsa Ud. que su hijo(a) es un buen oyente? Si 

4. ^Piensa Ud. que la escuela deberla proveer m&s 

instruccion en como llegar a ser un buen oyente? Si N6^ 

5. iPlensa Ud. que su hijo(a) lee bien? Si N6^ 

6. lEstk Ud. 8ati8fecho(a> c6mo la escuela le esta' 

enseSando a su hi jo (a) a leer? Si N6__ 



7. De acuerdo a su experienca ic&no piensa Ud.. oue su hijo(a) aprende mejor? 
(mfiroue uno o mis de los siguientes) 

mostrindole ^ mostrfindole fotos or dibujos - 



explicindole dSndole premios 

dejfihdole que 16 descubra trabajando con Ud. ^ 

por si mlsmo otra manera (favor de escribirla) 



dej indole que 61 lo lea 



8. iTiene su hijo(a) un problema especial en aprender que 

la escuela deberla saber? Si Vo^ 

9. Si contest6 si a la pregunta, favor de explicar 



INFOmCION QUE NECESITAMOS SABER ACERCA DE SU FAMILIA: 

!• Favor de Indlcar los mlembros de la familla que vlven en su casa: 
padre hermanos cufintos 

cu&ntas 



madre 



hermanas 



2. tQulin es el jefe de la famllla? (mirque uno) 
padre guardifin 

madre otra persona (favor de especlf lcar)_ 



3« iQut clase de trabajo hace el jefe de la famllla? (favor de expllcar 
lo me J or que pueda) ] ^ 



A. 
5. 
6. 



lEsti el jefe de la famllla empleado ahora? 



SI 



graduado de la escuela 
cecondario o industrial 



No 



^Es el jefe de la famllla empleado en su proplo negoclo? 81 No^ 
iCuSntoa anos de escuela complet6 el jefe de la famllla? 

menos del 7o. grado ' unlversldad' 

grados 7', 8,o 9 grado unlversltarlo 

grador 10 o 11 graduado profeslonal 
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APPENDIX G 



Evaluation of Use of Set 1.0 of 
APT Lessons in Bilingual Diagnostic 
Placement Program, Santa Ana, CA 

by V 

Herb Michel, .Perception Teacher 



Choosing Participants 

^ 

1. How were the children and the adults in the program chosen? 

Adults were chosen because of expertise (perception instructor and 
speech therapist of special education complex) . All 72 children in Bilin- 
gual Diagnostic Placement Program were eligible, but only 49 of those 
showed classroom auditory deficiencies, which, supported by low Goldman- 
Fristoe-Woodcock scores, qualified them to be subjects. 

3. Were participants in the program involved in other programs? 

Of the 1*9 subjects, many were involved in speech therapy sessions which 
often utilized auditory approaches. 

4. "How many participants left the program? 

— ^ Four students left the pr»ogram before it was ended. 

5. Which participants left? 

One subject was removed because of inability to attend and understand 
(after 1.1). Three students moved. The first book was given up to 1.3 

'with a break for post program testing in our p3?ogram. All the 46 students 
participated up to that point. After our testing only 15 students worked 

.on book 1.5 and book 2.1 (2.1 was extremely difficult) . 

7. Were there many participants added to the program to replace dropouts ? 

Yes, about 10 students were absent enough to have to review several 
preceding tests to reinforce their skills. No student was allowed to skip 
books (except the students pn book 1.5 and 2.) and progression was book by 
book. 

8^ Did participants attend voluntarily? 

No, each participating individual was scheduled into a time module with 
his group. There were no violent reactions against it and most attended 
pleasantly and with desire. 

9. Was the evaluation group only a portion of the program group? 

No, all the participants were evaluated. However, one gTOup proceeded 
ahead of the others. _ 
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Describing Participants 

1> Which participants received the program? 

All students showing auditory difficulties in classroom and/or low 
scores on Go ldman*Fristoe -Woodcock test* 

2. How many participants received the prog^ram? 

49 (one was removed because of inability to understand or attended 
inadequately) but 3 left after completing pages 3A and B of book 1,3, 

3. What are the ages or grade"i.evels of pupils in the program? 

Ages of students: 6-1 10-10 

7-6 11-7 

'8-8 12- 3 

9 - m One removed was 7 years old. 

4. Bid the program serve many more boys than girls ^ or vice versa? 

The program served more boys than girls. There were 30 boys and 19 
girls* The one removed was a girl. 

5. What achievement scores were available before the program with which 
to describe the program group. \ ! 

\. 

Children were functioning at least 2 grade levels below their normal 
chronological placement. Some were even less and one was untestable. The 
Wide Range Achievement Test (WRAT) was our measurement tool. 

6. Are there other special characteristics you should mention in describ- 
in;^ the pro^gram-group? f 

All educational problems were represented - limited eye sight, poor 
learning, attending lifficulties, and mental processes. 
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Measuring Changes 



1. What measures were applied to find out whether the program's aims were 
achieved? 

A behavioral objective of 75 percent correct on each page was estab- 
lished for all students and was recorded as either achieved ( ) or not 
achieved (-). Then the whole book had to have a minimum score of 75 per- 
cent correct or the book had to be repeated before the next one could be 
attempted. Positive performance indicated adequate achievement and nega- 
tive performance meant at least one repetition of the book. With a posi- 
tive score after a negative one, the child gave evidence of his growth 
(which was pur sole aim) . 

2. How were the measures matched to the objectives? 

and 

3. How were the measures matched t the ..^^^--ils' capabilities ? 

P-, More pre-performance instruction was given to lower mental age students, 

a special device was fitted to help the girl with eye problems to focus on 
the correct figures L Only four students were tested at a time and each was 
fitted with ear phones. The objective did not change for individual children 
because the skill that was being developed is one all children will need, and 
the objective seemed a minimum level necessary for all. 

4. Were observers specially trained? ^ 

Not other than observations in Fremont and other readings. The Speech 
Therapist, however, is well versed on auditory^problems and programs. 

5. How much time elapsed between testings? 

Testing was done two days a week (each group worked either Tuesday and 
Thursday or Monday and Wednesday) for four straight weeks. 



Comments ; With our children it appeared that more stimulation was needed 
to hold attention. Perhaps color will help. It seemed that the progression 
cf skills "was too rapid or required too many tasks in sequence - such as 
(1) finding right row, (2) using right" colored pen, (3) hearing the sound 
clue, (4) make the correct mark, (5) on the connect picture. I would like 
to use this program next year with EMR children' with mental ages of at least 
10 years on a single basis - not groups. 
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